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This thesis develops and analyzes a model to identify 
personal attributes of a successful recruiter. Expert 
Systems software is used to elicit from five U. S. Army 
recruiting experts characteristics associated with recruiter 
success. Experts included current and former Active Guard 
and Reserve (AGR) recruiters from various levels of the 
U. S. Army Recruiting Command. An interactive computer 
program based on Quasi-Artificial Intelligence (QAI) 
captured the experts’ knowledge, experience, judgments, and 
intuition to create expert systems that can be used to make 
recruiter selection decisions. The study finds that 
personal characteristics such as Integrity and Motivation, 
and skills such as Listening and Informing are substantially 
more important than the types of attributes generally used 


to predict recruiter success. 
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I. INTRODUCTION 


hee tHe PROBLEM 

One of the most challenging tasks confronting the 
military services in the All Volunteer Force era is field 
recruiter selection. Effective selection procedures 
increase the likelihood that the services will recruit 
enough people to meet their authorized strength levels, 
their recruiting goals, and their assigned missions. 

Although recruiter selection processes vary by branch of 
service, they share a major flaw: the processes used do not 
provide enough information about whether these people will 
be successful recruiters. Military assignment practices do 
not incorporate sales aptitude testing or profiling of those 
Characteristics found in successful recruiters. In some 
cases, personnel have been assigned to recruiting duty 
Simply because they were available for transfer at the same 
time that a recruiting job became vacant. 

The purpose of this thesis is to identify attributes 
associated with successful recruiters. Enis ers a useful 
area of research that could improve the services’ recruiter 
selection procedures and assignment practices. Better 
Becruiter/job matches could increase productivity and 
morale, and reduce turnover and related costs resulting from 
moving, training, and replacing recruiters who are not right 


for the job. 


The services can benefit from a model developed to 
identify personal characteristics that can be used to help 
select, assign and train personnel who are most likely to 
become successful recruiters. As resources continue to Grow 
scarce and competition increases for a shrinking suppl yee 
age-eligible male youth, the military services will need 
recruiters who can work effectively and efficiently if the 


All Volunteer Force is expected to survive. 


B. PURPOSE 

A model will be developed and analyzed to identify which 
attributes make the most valuable contributions 1EIe: 
successful performance as a recruiter. All services will be 
considered, but the emphasis of the study will be on the 
U. S. Army because data are readily available for its 
recruiting personnel. This thesis will concentrate 
specifically on the personal attributes associated with 
recruiting success of the U. S. Army's Active Guard and 
Reserve (AGR) recruiters. 

At the JU. S. Army Recruiting Command (USAREC), success 
of an AGR_ recruiter is based primarily on achieving the 
assigned recruiter mission, or goal. One objJe€Ctlve oLeemme 
thesis is to critique the applicability of existing USAREC 
data for this type of analysis. For example, production 
data may be unsatisfactory because production reflects 


several factors other than a recruiter's individual 
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DEeeuUcCtMyLty, such as the potential of the market area, 


management policies, etc. A second objective of this thesis 


is to develop a profile of a successful recruiter. 


C. BACKGROUND 

fn 1979 USAREC became responsible to recruit people for 
the U. S. Army Reserve (USAR) in addition to its Active Army 
recruiting mission. This additional mission posed a 
multitude of problems for USAREC in light of the fact that 
the USAR is a geographically limited entity, unlike its 
Active Army counterpart. 

In support of this task, USAREC now has approximately 
1780 £ield Active Guard and Reserve (AGR) recruiters. This 
is a volunteer force chosen by USAREC from a field of 
solicited, qualified USAR applicants. Carefully selected 
recruiters are needed to ensure that the Army's” reserve 
units are filled to authorized strength levels. 

Currently, the selection criteria for AGR recruiters are 
based upon administrative regulations and personal 
interviews or references at the Recruiting Battalion level. 
some of the criteria contained in administrative regulations 
are described in general below. An AGR recruiter applicant 
must: 


1. Be in paygrade E6 or E7 (waiverable for ES members if 
insufficient numbers of E6's and E7's apply). 


PemuavemaeG. Score GE 110 or higher or ST score of at least 
100 (no waiver). GT, general technical aptitude, is a 
composite test score formed by combining the Verbal 
Comprehension and Arithmetic Reasoning subtests of the 


1 al 


Armed Services Vocational Aptitude Battery (ASVAB). 
ST, skilled technical aptitude, is a composite that 
measures ability to read technical manuals, etc. 


3. Be a high school diploma graduate or have one year of 
college and a GED (no waiver). 


4. Have less than 15 years Active Federal Service. (Member 
must be able to serve at least five years on active duty 


before becoming eligible to receive military retired 
pay. ) 

5. Be at least 21 and not older than 35. 

6. Have no marital, emotional, financial, or major 
medical problems that would hamper performance on 


recrultinegeauty- 


7. Be interviewed and recommended by recruiting battalion 
personnel (no waiver), and 


8. Meet requirements concerning number of dependents, 


physical standards, past performance, military appearance, 


and others. [Ref. l:p. 15] 

USAREC has 56 recruiting battalions and other commands 
Within its organization as depicted by Figure 1.1. Each 
Battalion Commander is responsible for solicitgiae 
applications and conducting interviews to fill AGR vacancies 
within that battalion. (Most AGR positions within a 
recruiting battalion are recruiter positions, so AGR 
recruiters essentially recruit thelr own replacements [Ref. 
23 Even when no vacancies exist within a particular 
battalion, production continues, and the battalion continues 
to select AGR recruiters who will fill other AGR recruiter 
vacancies within USAREC. Figure 1.2 outlines the procedures 


for selection and training of AGR recruiters [Ref l:p. 25]. 


HEZ 


USA REC 


USAREC has 5 
Recruiting Brigades. 
(There is no 3rd 
Brigade.) 


There are 9 

Recruiting Battalions 
within the 6th Brigade 
and a total of 56 
within USAREC. 
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Figure 1.1 The U. S. Army Recruiting Command 
Organizational Chart. 
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After the interview is completed, the Poeial ten 
Commander selects or rejects the applicant and forwards the 
application to USAREC for administrative review. toe 
USAREC's review is favorable, the application is sent to the 
Army Reserve Personnel Center (ARPERCEN). This is where the 
final decision is made. If ARPERCEN's review is favorable, 
orders are issued, and the new recruiter receives a specific 
recruiting assignment. 

Before starting work, the new recruiter must complete 
the Army Recruiter Course at Fort Benjamin Harrison. The 
recruiter remains in an Active Duty for Training (ACDUTRA) 
status until completing the training course. ips OO Liley 
provides USAREC and ARPERCEN some flexibility should the new 
recruiter fail the course. Instead of keeping a failed 
recruiter on active duty for three years in a non-recruiting 
job, ACDUTRA can be terminated, and the person can be sent 
home. 

The interview phase is probably the most important part 
of the recruiter selection process, yet this is where 
regulations and guidance appear to allow the most variation. 
Beactesrecruiting battalion has the authority to conduct 
interviews based on its own rules and needs. Piss i CaaS 


concelvable (and highly likely) that procedures vary among 


battalions. Interview policy and decisions such as number 
Or board members (iS a one-member board allowed?), 
officer/enlisted mix, experience of board members (are 
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members required to have recruiting experience?),> lengmiuer 


boards, and questions asked vary not only from one battalion 
to another, but also from one board to another within the 
same battalion. A possible result is that different boards 
might make different decisions about the same applicant 
based on the particular experience, judgments, biases, and 
intuition of any one board's members. The subjective nature 
of the interview process could well result in a wide variety 
of decisions, some of which may be more likely to yield 


placement of successful recruiters. 


is 
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All of the military services have studied ways to select 
the best recruiters. This task grows more critical in the 
All Volunteer Force era as competition grows among the 
services for a shrinking pool of age-eligible males. 

This literature review will provide an overview of 
research on the selection of successful recruiters. The 
review will include discussions of methodologies Or 
determining factors associated with successful recruiting, 
commonality of resultant factors, problems encountered, and 
will conclude with an assessment of future research needs in 
Ehis area. 

This literature review will address the following 
questions: 


a. What profile of successful recruiters has been 
identified by previous research efforts? 


b. What methods were used to identify these characteristics? 
c. Are the results consistent and valid? 
qd. What limitations and problems exist in previous work? 
e. What are the implications for future research? 
While all military services are represented in the lit- 
erature, Air Force studies are outnumbered by a wide margin. 
There appear to be at least two logical reasons. hon one 


first few years after the inception of the All Volunteer 


i, 


POnrce- the services fielded volunteer recruiter forces. 


That situation has changed. Today, all services except the 
Air Force rely on recruiting forces comprising mainly ee 
volunteers. Another explanation for the Air Force's 
comparatively small body o£ research on recruiter SsSelee@iia 
is that service's historic recruiting success. The Air 
Force has been the number one service choice among potential 
Sraistees for decades, and the service has me@Cuae. 
recruiting goals with no apparent difficulty. Thus, thea, 
Force has not had as much of a need to examine the recruiter 
selection issuer 

Although various methods have been used to conduct 
research in recruiter selection, most researchers used 
paper-and-pencil test batteries in their  attenpes to 
identify characteristics of successful recruiters and 
predict recruiter — pértorjaence: Other researchers used 
biographical information, structured and unstructured 


interviews, job analysis, assessment centers, and other 


methods. 

Although most older studies reviewed presented 
reasonable hypotheses, sound analysis, and interesting 
conclusions, results in many cases were disappointing. Bet 
several studies, few Eindings were statistically 
Ssilqniticant- In others, findings that were significant had 


dubious meaning because they were not cross-validated. In 
still others, when cross-validation was attempted, original 


results could not be dupliecavec: 
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Some researchers shared comman problems in their work 
Ehavemdinpene Lomtouesmloaingtheimedisappointing results. The 
Mest common Was GUpped the "eriterion problem”: measuring 
recruiter performance ina reliable and valid manner [Ref. 
3:p. 16]. Researchers have used supervisory ratings, school 
performance, percent of quota achieved, and total number of 
recruits enlisted as performance measures, among others. 
Yet, supervisory ratings are often unreliable and of 
questionable validity (Ref. 4:p. 1]. Even with the best of 
intentions, supervisors can be influenced by characteristics 
unrelated to job effectiveness. This can lead to 
evaluations based on reputation rather than performance. 

For example, as one study explained, a recruiter might 
be rated high because he is likable and has good military 
bearing and a good production record. Yet, the recruiter's 
successful production might be the result of having been 
assigned to a fertile recruiting territory. [Ret .@52o9a014") 
Graduates of recruiting school may perform differently in 
the field than they do in training. Finally, using 
recruiter beocuci lone figures that do not account for 
"opportunity bias," the relative ease or difficulty in 
obtaining enlistments ina particular area, fails to examine 
Varlations in productivity due simply to differences in 


individual recruiters [Ref. S:p. 16]. 


sg 


Another problem that plagued some research was a lack of 


information about the recruiter's job. Several studies 
attempted to correct this by identifying tasks recruiters 
perform, and later research benefitted fErom interme 
collected through job analysis. 

The selection environment, while “nor exactly a 
"problem," has become a necessary consideration in recruiter 
selection. Since most active duty recruiters are now 
selected involuntarily recent research attempted tc 
identify reliable recruiter selection methods that would noe 
be vulnerable to compromise or "faking," as test batteries 
are. (The number of recruiters selected involuntarily 
varies by branch of service. The Air Force is currently the 
only service whose active duty recruiters are all 
volunteers. Selection procedures also vary within a 
service. For example, nearly all of the Army's Active Guard 
and Reserve (AGR) recruiters are volunteers, yet most 
recruiters who enlist people into the Regular Army are non- 
volunteers.) Researchers in favor of more passive methods 
advocate the use of demographic, biographical data the 
services maintain routinely in various data banks. 

The next section discusses relevant studies organized by 
research method. Unless particularly relevanr older 
studies are discussed fairly briefly. More recent work is 


discussed in greater detail. 
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A. INTERVIEWS 
fi ScOrman, moudgn, and Dunnette 

A 1976 report published by NPRDC describes’ the 
efforts of — Borman, HoUuGg he and Dunnette to develop 
behaviorally-based rating scales to evaluate the performance 
of Navy recruiters. During two days of workshops, more than 
800 critical incidents (examples of recruiter performance) 
describing effective and ineffective recruiting performance 
were obtained from field recruiters from all Navy Recruiting 
Areas. Another 135 performance examples were solicited from 
Navy recruits during interviews at boot camp. Researchers 
believed that an extensive analysis of the recruiter job 
would be required before any further research on recruiter 
selection could be accomplished. To become familiar with 
the recruiter job, the researchers went to those who knew 
the job: recruiters, supervisors, and recruits. NPRDC's 
1976 study was the springboard for three additional studies 
conducted over the past ten years. These studies are 
discussed in the next section. [(Ref. 6] 

¢. Borman, Toquam, and Rosse 

A 13977 Army Research Institute study [(Reft. 7] 
hypothesized that a reason why paper-and-pencil predictors 
of Army recruiter effectiveness may have met with such 
little success was that not enough was known about’ the 


performance requirements of the recruiter job. This study 


ral 


focused on discovering these performance requirements by 


attempting to define the underlying task dimensions 
associated with Army recruiter and guidance counselor jobs. 

The first step was to revise an existing Department 
of the Army task list that described the occupational 
designator QOE Military Occupational Specialty (MOS). Army 
recruiters and guidance counselors share this MOS because 
their jobs are similar. The recruiter's job 1S” tommgen 
people to enlist. The guidance counselor's task is to 
convince them to reenlist. The Army maintains lists of tasks 
performed in most MOSs. With the assistance of Army 
recruiting personnel, the authors shortened the exi@sinmg 
task list, or inventory, by removing outdated items and 
combining others that were similar. 

After a pilot test, the revised task inventory was 
administered to 101 field recruiters, guidance counselors, 
and supervisors across all five recruiting regions. These 
101 people, who were familiar with the recruiter and 
guidance counselor jobs, sorted the tasks into groups, or 
dimensions, according to the tasks' perceived similarity 
with respect to job function. Participants worked on their 
own, each sorting task statements into categories. 

Before analyzing the data, researchers tested the 
extent of agreement in solutions by dividing participants 
into various subgroups: recruiter and guidance counselor 


groups, District Recruiting Command (DRC) subdgroups7 ee 
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Once consistency in responses across subgroups was 
established, the data were collapsed across all subjects and 
analyzed. The two types of analyses performed were 
multidimensional scaling (MDS) and a Ward and Hook 
clustering procedure. 

Results indicated that people in the different DRCs 
agreed substantially among themselves about the pattern of 
similarities among tasks. Guidance counselors and 
recruiters agreed closely, and supervisory personnel = saw 
much the same pattern of task similarities as those they 
supervised. since no serious disagreements in responses 
existed, the solutions were collapsed across the entire 
sample, and a summary list of task dimensions was formed 
(see Table 10 jae This composite list contained four broad 
dimensions defining general task areas associated with the 
recruiter's and guidance counselor's role in the Army 
recruitment process. 

Borman et al., believed these dimensions would be 
useful in developing selection procedures for potential Army 
mecruiters. They believed the content of the dimensions 
would suggest the types of personal characteristics and 
attributes necessary for effective recruiter performance. 
Then, paper-and-pencil measures of these attributes could be 
chosen or developed as indicators of potential for top-level 
performance in Army recruiting work. The authors also 


suggested that the dimensions could serve as performance 
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TABLE 1 


Composite List of Task Dimensions 


I. Prospecting Activ inane. 


Identifying and contacting qualified prospects. 

- using existing name sources £0 generate |istcma: 
DROSPeGcus 

= Contacting prospeers 

- dealing with centers of influence and other persons 
in the schools and in the community for the purpose 
of gathering prospect names 

- obtaining referrals 


Lisvmes P ubdgieaZ ingmEne sat my, 


Building a positive Army image in the community by setting a 
good example and by providing favorable publicity for the 
Army and Army enlisted programs. 
- conducting Army publicity programs in the schools or 
in the community 
- working with the news or other media to obtain 
favorable publicity for the Army 
- performing community services and working with 
community groups to enhance the Army's image 
- preparing and delivering presentations about the Army 
to civic organizations, at career counseling sessions, 
Or at recruiting -seminac- 


{IIil. Selling the Army 


Getting individuals to join the Army by counseling them, 
explaining Army benefits and opportunities to them, and 
Pee oo een the advantages of Army.life. 
describing aspects of Army life, benefits, and 
opportunities to prospects 
- conducting interviewing or counseling sessions With 
prospects to sell them on the Army 
- answering questions about the Army and about enlist- 
ment; overcoming objections to joining the Army 
service 
- sizing up individual prospects and talloring the =imeems 
view to help sell Army 
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TAC eae 


Composite List of Task Dimensions (Continued) 


davies Administrative Activities 


Working with recruiting reports, records, statistics, etc., 
pew ordanmlzing recrulting activities. 
= preparing maintaining, and reviewing enlistment 
reports 
- planning recruiting activities: performing market 
BeSedeciyezomunGd reeruLeing areas, etc: 
- Maintaining recruiting statistics and records 
Zeeniceacalningsrecrulting publications 


{Ref. 7] 


ZS 


rating scales in future selection research intended to 


ensure that selection procedures chosen were, in fact, 
validly identifying persons with good potential for Army 
Bele mudive imc (This Sruay did eno identify personal 
characteristics and attributes of success f£uz Army 
recruiters; however, Borman is currently working on a 
project to develop performance-based rating scales for Army 
recruiters similar to work he did for the Navy in 1376 
3. Graham, Brown, King, White, and Wood 

An Army Research institute study describes 
Structured interviews conducted with 79 Army recruiters’ to 
obtain information on the nature of recruiting duty eghoae 
Se The sample was selected to represent recruiters with 
high, medium and low records of success, in terms of 
percentage of quota achieved. Information collected from 
the interviews was used to develop hypotheses on _ the 
personal characteristics and job behaviors associated with 
recruiter success. These hypotheses would be evaluated more 
rigorously in later research. 

Interviews solicited the following types @ xe 
information from recruiters: background character ismiea 
suggestions about recruiter training, the value of various 
prospecting and selling techniques, workload, attitudes 
toward the job, personality characteristics that might be 
related to recruiter effectiveness, and descriptions of 


successful and unsuccessful recruiters they knew. Responses 
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were coded, categorized, and analyzed to show: (1) personal 


characteristics and job behaviors related to recruiter 


SuoGuctlon records sana (2) personal Characteristics and job 


behaviors attributed (by the respondents) to successful and 


unsuccessful recruiters they knew. 


The criterion used as a productivity measure was the 


percentage of the total non-prior service (NPS) quota 


achieved ina six-month period. The authors realized the 


limitations of this measure, but felt it was the best 


obtainable within their time and money constraints. 


Rechileutensommyveremmp macecaQmmento criterion groups of 


high, medium and low producers based on production data. 
Interview responses were coded into broad categories. 
Relationships between interviewee responses. and their 


production records were explored in two ways: 


a. 


small 


Comparison of high and low producers (chi square 
test). The authors hypothesized that high and low 
producers' scores would differ significantly in many 
categories. 


Correlations between presence in a category and 
production records. Each recruiter was assigned a 

score of 0 or 1 based on whether or not he was described 
by a response within that category. Category scores 
were correlated with the production criterion to 
determine relationships between response categories and 
Ehewserilter ton. 


The authors warned that this pilot study used a 


sample that may not have been representative of 


recruiters in general, and that their findings should be 


Exe 


regarded as indicat lens @jic possible Significant 
relationships whose validity would need to be assessed by 
EUEuie EeSe arch. 

Few of the characteristics in the sel £—-deseripimaan 
data were significantly related to production records. Some 
of the study's findings are listed here. 


a. Attitudes Toward the Job - "Likes independence" 
correlated significantly and negatively with job 
success (r = -.24), suggesting that high producers 
were less likely than low producers to "eae 
"independence" as a source of job satisfaction. 
Recruiters who commented on their dislike of 
"long hours," "the frustrating nature of thewjiciee 
etc., tended to be more productive than those who 
did not make those comments. 


b. Prospecting Techniques - According to successful 
recruiters, this is one of the most important compo- 
nentssot the Jjcbke The objective is to bring the 
recruiter into direct personal contact with 
potential enlistees. successful recruiters emphasized 
that they spent many hours daily in prospecting 
activities. Two response categories, "Uses system- 
atic approach" and "Uses Pre-induction physical 
cards, mail-outs, etc.," were statistically 
Significant. 


c. Selling Techniques ~- The ability to motivate a 
person to enlist is believed to be an important 
characteristic of the successful recruiter, yet 
none of the selling techniques mentioned by recruiters 
interviewed were significant. 


qd. Communications Skills - A highly successful 
recruiter must be able to communicate effectively. 
One category, "Has difficulty communicating 
effectively" correlated negatively and significantly 
with the production criterion. Thus, high producers 
admitted having communication problems less often 
than low producers. 


e. Industriousness - The pilot study did not reveal 
much information in support of the idea that hard 
work is essential for successful recruiters. Although 
several recruiters described themselves as "motivated" 
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a _ i ee a a. 


or as "self-starters," these responses were not 
BroMierecantiy relacea to ign or low production. 


Only one response category, "Keeps informed on everything 
relevant to job," differentiated significantly between 
hidieana dow proaucers. 

f. Miscellaneous Personality Traits - "Empathetic" 
correlated negatively and significantly with the 
ProOcduetion criterion. The authors suggested that 
empathy seemed to be a highly valuable characteristic 
Eom “al peeruiter, yet it correlated negatively 
with success. McMurry suggested that high empathy 
may be a handicap to a salesperson unless it is 
accompanied by a strong ego drive or will to win 
(Reise pp. 82 ie 

During the interviews, each recruiter was asked to 
think o£ one successful and one unsuccessful recruiter he 
knew and answer questions about the two recruiters!’ work 
attitudes, job skills, personality traits, etc. 

The authors believed many recruiters' responses were 
actually elements ina Stereotype of the good recruiter, 
which they may have acquired in training or elsewhere, and 
not based on actual observations of the nominee. They were 
not surprised by the data and believed this peer nomination 
@aeua Should be regarded as recruiters’ opinions o£ what it 
takes to be a good recruiter rather than descriptions of 
good and poor recruiters. The recruiters' conceptions of 
the successful and unsuccessful recruiter are included in 
Table 2 for information. (Note: Data on successful and 
unsuccessful recruiter nominees were provided by the same 
respondents. As a result, Ene we hi -sgquare statistic 


exaggerates the significance of the difference between the 


two groups. ) 
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TABLE 2 


Characteristics Differentiating Successful and 
Unsuccessful Recruiters: Peer Nomination Data 


Nominees 
(in Percent) 





Successful Unsuccessful 


Category? : = = 


Motivations For Becoming a Recruiter 


Dislike for present assignment 9 43 


Prospecting Techniques 





Uses systematic approach 52 1 
Stresses person-to-person contact 62 19 
Uses high school CIs 31 2 
Uses other CIs 9 0 
Uses PIP cards, mail-outs, etc. 24 5 
Becomes involved in community 35 6 
Passively waits for prospects to walk in Zz 4g 
Emphasizes peripheral duties 1 32 
Emphasizes outside interests 1 14 


Selling Techniques 


Uses miscellaneous effective sales 


techniques . 24 4 
Uses miscellaneous ineffective sales 
techniques 0 11 


Communication Skills 


Able to communicate effectively 39 14 
Has difficulty in communicating 
effectively 0 18 


Job Attitudes 


Likes the work 86 20 
Likes the challenge of the job 17 0 
Dislikes the high pressure 19 34 
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AER 
Characteristics Differentiating Successful and | 
Unsuccessful Recruiters: Peer Netimatron Data (Continued) 


Nominees 
(in Percent) 





Successful Unsuccessful 


Saregory— : -_ 


Job Attitudes (Continued) 


Dislikes other features 3 25 


Wants another type of duty 10 53 
Industriousness 

Has high achievement motivation 18 3 
Has low achievement motivation 4 U7 
Is very conscientious 52) 3 
Is careless about details 1 19 
Seeks ways to improve 8 0 
Keeps informed on everything related 

to job 18 4 


Miscellaneous Personality Traits 


Friendly, easygoing 35 4 
Outgoing yy 0 
Sympathetic 20 0 
Stable 13 0 
Happy, humorous 11 0 
Light-hearted 10 0 
Sincere ; eto 1 
Withdrawn 1 17 


Shy, self-conscious 1 
Lacks self-discipline 1 
Has family problems 1 
Inconsistent 0 
Hostile 0 13 
Emotionally immature 0 
Resentful, rebellious 0 


4411 categories included in this table differentiated the two 
groups of nominees at the .05 level of significance or beyond, 
using the chi-square test. 


(Ref. 8) 
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(The more general the characteristic and the more congruent | 


with stereotypes of the good and bad recruiter, the more 
frequently it was mentioned. ) 
some questions in the interview asked the recrumteaue 
for their opinions about recruiter selection. A summary of 
responses the recruiters mentioned most often and the 
percentage of those responding appears in Table 3. 
4. Hirabayashi and Hersch 
A recent effort attempted to document 
characteristics of excellent Navy Recruiting Districts [(Reé€. 
go.) The authors visited and interviewed key individuals 
assigned to these and other Navy recruiting activities. 
Interviews were representative of the Navy Recruiting 
Command: current and previous Recruiting Command commanders, 
commanding officers, executive officers, department heads, 
recruiters, recruiters’ supervisors, trainers, and more. 
Based on the results of the interviews, the following list 
summarizes the characteristics of successful recruiters. 
Successful Navy Recruiters: 
- are movers, shakers, and salesmen 
- are hungry for success and/or promotion 
- are aggressive, want responsibility, and want to excel 
- possess outstanding communications skills, a fundamental 
knowledge of recruiting, and an inherent skill to deal 
with numbers, sales, and the public 


- are ambitious, extroverted, and like to meet and talk tc 
people 


- are positive, cheerful, enthusiastic, and self-motivated. 
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TABLE 3 


Recruiters' Opinions Regarding Recruiter Selection 


Response 


Should 


Should 


Should 


Sereen 


Should 


Should 


Should 


Should 


Should 


be able to talk to people 

have well-groomed appearance 

want to do the job 

for quality of past performance 

have "substantial" length of service 
enjoy working with people 

be stable in finances 

have sales experience 


be adaptable 


Tell then what recruiting is really like 


Provide two months of OJT 


Should 


be outgoing 


(Ref. 8) 


oS 


Percentage 
4g 
33 
30 
28 
24 
20 
16 
13 
3 
18 
11 
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Bo. TEST Sater ies 
1. Wollack and Kipnis 
These authors developed a test battery to determine 
its possible usefulness in Navy recruiter selection [Re€. 
TCalr. The battery's thirteen tests and inventories measured 
fluency of expression, Knowledge of the Navy, interesiia 
recruiting activities, and general aptitude. 


The study used commanding officers' nominations of 


effective and ineffective recruiters as the criterion 
measure of performance. Items that differentiated between 
effective and ineffective recruiting beyond the 48, 


confidence level were retained for cross-validation. 

Although few of the battery's items and scales 
cross-validated significantly, the study's results suggested 
that inventories showed promise as indicators of recruiter 
effectiveness. Borman suggested that the poor. cross- 
validation results may have occurred because raters made 
their evaluations of recruiters based on reputation instead 
of performance or because many of the individual differences 
that predict recruiter success were not included in the 
battery. (Ref. 3:p. 4). 

2. Massey and Multins 

Only one Air Force study appeared in the literature 

reviewed. Massey and Mullins (1966) developed an eight- 


inventory battery to measure qualities such as empathy, 
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surgency (friendliness and sociability), and perseverance, 
Mi DoInesized te pe desirable im recruiters [Rer. 11]. 

Predictor variables were correlated with school 
success and supervisor field ratings. Results after cross- 
validation indicated that the battery would be useful only 
marginally in predicting school performance and not at all 
in predicting field ratings. The authors believed the 
Supervisor rating criterion had caused the poor results, 
suggesting that it was contaminated by several rater errors 
such as "halo" and "leniency" effects. They advocated the 
development of a more reliable and valid measure of 
recruiter effectiveness. 

3. Krug 

In this study, a personality test is developed and 
administered to officer and enlisted Navy recruiters. to 
determine its usefulness in predicting sales ability (Ref. 
ee} The test, the 16PF-m, was a variation of the 16PF, a 
nee ah] y regarded personality inventory widely used by 
business and industry in sales selection (Ref. 13:p. 22]. 

In addition to the 1967 version of the 16PF 
questionnaire, the 16PF-m included a supplement designed to 
measure motivational distortion (a lie scale) and strength 
of motivation to succeed as a recruiter, and seven 
biographical items: years of service, age, sex, marital 
status, number of dependents, years of formal education, and 


population of subject's Home of Record. 
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Commanding officers’! nominations of recruiters seeeem 


the top and bottom fifty percent of those on Frecruitingmames 


at the time were used as the criterion measure of 
performance. Stepwise multiple regression resulted in a 
multiple regression coefficient o£ .40 (p « .01). Emig 


validation, the multiple regression coefficient was .25 (p <¢ 
‘gigs e Results indicated that the typical effective Navy 
recruiter was married, had more years of formal education, 
and tended to be warm, outgoing, dominant, aggressive, and 
self-assured, with relatively conservative political views. 

The Navy Recruiting Command used this battery to 
screen people for recruiting assignments for approximately 
four years between 1972 and 1976. Active duty Navy 
personnel took the test if they were being considered for a 
recruiting assignment. Those who scored below thirty-five 
were considered unqualified for recruiting duty. (A score 
of sixty-five was recommended by the study team and was 
predicted to be seventy-two percent accurate, but the Navy 
Recruiting Command chose to use a score of thirty-five.) 
Use of the test was discontinued when Navy Recruiting 
Command and the Chief of Naval Personnel (Pers 502) agreed 
it did not predict sales ability effectively (Ret. iigmes 
24). 

In his 1976 study, Arima stated the 16PF had little 


or doubtful utility in the selection process due to the 
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fosemecmmcr edareltanle and valid criterion (Ref. 14}. He 
called for job analysis and behaviorally-anchored rating 


scales. 


Me development Of a recruiter selection procedure must 

be preceded by a thorough analysis of the position that 

will show the functions performed and the relative 

iMnpertanee OReeiomrEUnetULOnS.. fee wllitealso be necessary 

to obtain knowledge as to the types of behavior that are 

necessary to carry out these functions successfully 

and the types of behavior that are detrimental. There 

is nothing new in this approach .. . developing 

behaviorally anchored rating scales could provide the 

desired list of behaviors. Knowledge of the job 

should provide the material to develop a recruiter 

selection procedure. [(Ref. 14:p. 129]. 

4. Larriva 
The 16PF-m was applied to a sample of Marine Corps 

mecruilters ina concurrent validity study in 1975 (Ref. 15). 
pamnuale non-prior service accessions were used as the 
criterion measure of performance. The test did not predict 
well, and Larriva suspected the criterion he used had caused 
the problem. He experimented with several performance 
indices, examined predictor criterion relationships, and 
chose the index that resulted in the most valid multiple 
correlation coefficient. This index separated urban and 
rural recruiters and corrected for geographic differences in 
relative performance of recruiters. Cross-validation 
suggested the l16PF-m might be useful in screening for’ the 
Meaieine Corps recruiter job [Ref. 3:p. 8]. 


Borman et al. objected to Larriva's method of 


criteria selection, saying that amore acceptable (and 


a7 


justifiable) method would have been to define a precise 
Criterion first and then select a measure that would prowagee 
relevant and reliable measurement of the criterion without 
regard to the predictors ([Kertwes p72 
5. Abrahams, Neumann, and Rimland 

In 1973, the Strong Vocational Interest Blank (svi 
was used to develop a Recruiter Interest Scale (RIS) for use 
in selecting Navy recruiters. Items that differentiaged 
between the most and least effective recruiters, based on 
commanding officers’ nominations, comprised the RIS-1l, which 
was used for cross-validation. The top quartile (highest 
RIS scores) contained three times as many effective 
recruiters as did the bottom quartile. The bottom quartile 
had three times as many ineffective recruiters as the fop 
gQuartile. Although the authors stressed that a better 
criterion of recruiter effectiveness was needed and that 
other recruiter performance factors should be consideredmim 
future validity research, their study suggested that 
vocational interests might successfully predict recruiter 
effectiveness. [Ref. 16] 

6. G a ower 

In 1976, these authors also had some success with a 
version of the Navy RIS modified for Marine Corps 
recruiters. Although the Marine Corps Recruiter Intenmeen 
Scale (MCRIS) resulted in a higher validity coefficient than 


the Navy scale for the Marine Corps sample, the MCRIS was 
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hot cross-validated, which made aimee t comparisons 


imeessible. PEO tiem atenens menage USed recruiting 
officers' nominations of above-average, average, and below- 
average recruiters as their criterion measure, they called 


for amore reliable method of measuring recruiter  perfor- 





mance. (Ref. 17] 


ae, Borman, Hough, and Dunnette 


The most extensive work found in this area is a test 
battery developed by the Navy Personnel Research and 
Development Center (NPRDC). This work has evolved through 
four studies over the past ten years. 

NPRDC's work began with the development of 
behaviorally-based rating scales which attempted to identify 
better performance criteria than had been developed in the 
past for measuring recruiter effectiveness. Researchers 
believed that acquiring valid information about recruiter 
effectiveness meant that a thorough job analysis and 
criterion development effort would have to be accomplished. 
Their first study, published in 1976, identified more than 
800 critical incidents describing different facets Ot 
effective and ineffective recruiter performance. The 
study's suggested predictors of Navy recruiter effectiveness 
appear in Table 4. [Ref. 6] 

The second phase of NPRDC's research involved 
development and validation of an inventory battery to 


predict Navy and Marine Corps recruiter performance. Their 
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review of the literature provided candidate predictors that 
might be good indicators of future recruiter effectiveness, 
Lever Le abiele; vocational interests, interest inventories, 
background or biographical variables, and personality or 
trait measures. Recruiter abilities appeared unrelated to 
recruiter performance. Intelligence and other types of 
ability measures generally failed to predict recruiter 
success. [(Ref. 3] 

Based partly on their literature review and_ the 
results of their rating scales study, NPRDC developed a 
trial predictor battery that included several personality, 
vocational interest, and biographical items and scales. 
Battery scores were correlated with performance scores 
developed from supervisory, peer, and self ratings and from 
Six months of adjusted production data. (Standard scores 
were developed for each recruiter for each month by 
standardizing each month's production data within each Navy 
Recruiting District (NRD). This was an attempt to account 
for differences in recruiting opportunity across geo- 
graphical locations.) 

NPRDC‘'s third study was designed to expand and 
refine the original test battery and determine its validity 
in predicting recruiter performance. The revised battery 
was analyzed to determine the precision of new items in 
measuring desired constructs and whether they had improved 


the validity of the original test battery. Composites of 
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the added items enhanced the validity of the old battery's 


constructs in about half the cases. Scales derived from the 
constructs validly predicted recruiter effectiveness. [(Ref. 
18] 


NPRDC's final Special Assignment Battery consisted 
of three parts: the Strong-Campbell Interest Inventory, a 
self-description inventory, anda background questionnaire. 
Recruiter potential was measured through a selection 


composite composed of four subscales: selling skills, human 


relations skills, organizing skills, and overall 
performance. scores on each of these four "keys" were 
correlated with each recruiter's production data. Table 5 


displays validity £igures for predicting production. Three 
of four figures are statistically significant. 

When the four separate scores were summed into a 
composite, the correlation coefficient between the composite 
and production was .27. Figure 2.1 depicts the practical 
Significance of this relationship. Sixty-six percent of the 
recruiters scoring in the top 20 percent were in the upper 
50 percent in production, compared to 34 percent of those 
scoring in the lowest 20 percent. 

Several personality constructs correlated highly 
with various aspects of recruiter effectiveness. "Making a 
good impression" and "Enjoying being the center ee 
attention" correlated highest with selling skills. 


"Spontaneity, impulsivity" and "Ambitious, working hard" 
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TABLE 5 


Vlicity somenumclekeySueorelredicting Production 


(N = 194) 


Predictor Key Correltacion with 
Se Sian ES ©) elo Ko! clo Koy» eam 
Selling Skills “pe: 

Human Relations Skills ao 
OrzantiZi nmol) es 

Overall Performance 2b? 

eee) 1, 
(eet. 13) 
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correlated highest with the human relations skills category, 
while "Unhappy, lack of confidence" related negatively to 
human relations effectiveness. "Order, planning ahead" 
related well to organizing skills, and "Leading and 
influencing others" was the construct that correlated most 
highly in the overall performance category. The vocational 
interest constructs that correlated highly with performance 
criteria were interests in extroverted, dominant, social, 
and ieadership activities and occupations, interests in 
sports and competitive activities, and interests in law and 
political activities. 

The fourth phase of NPRDC's work, published in 1985, 
strongly confirmed the findings of the earlier studies. In 
concurrent and predictive studies, Marine Corps recruiters 
whose scores were in the top 20 percent obtained 27 and 40 


percent more recruits, respectively, than recruiters who 


scored in the lowest 20 percent. (Ref. 19] 
8. Brown, Wood, and Harris 


An Army Research Institute study, published in 1978, 
had two objectives: CPrmeraevelopea valid criterion o€ 
recruiter effectiveness and (2) develop a test battery to 
identify those most likely to succeed as recruiters (Ref. 
oi). 

The authors believed production scores were not a 
useful Gierrer ion because they were contaminated by 


"opportunity bias" caused by characteristics that influenced 
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the "fertility" of a recruiting territory but were weou cee 


the recruiiter's controle 

Army researchers and recruiters identified NS: 
factors that might cause opportunity bias, such as the 
unemployment rate in the territory, average number of 
enlistments per recruiter in the recruiter's District 
Recruiting Command (DRC), amount of recruiting experience, 
etc. A sample of 500 recruiters was chosen randomly, 100 
from each of five Army Regional Recruiting Commands nation- 
wide. Six months’ production figures were provided for each 
recruiter .; 

Stepwise multiple regression was used to predict the 


theoretical yield of a recruiter's territory using 12 ,o2uGRe 


5 territorial factors in the equation (three census 
variables were excluded). The three best predictors were 
"Average production per recruiter in subjects DRCye 


accounting for 48 percent of the variance in productign 
scores; "Average market share for station zone"; and 
"Proportion of the zone that is suburban." 

These three predictors, which accounted for 5l 
percent of the variance in production scores, were used to 
predict production scores for each recruiter. Benchmark 
Achievement Scores (BAS) were computed by dividing total 


production by predicted production and multiplying by 100. 
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The BAS were thought of as unbiased production scores, 


Somgeectea for the effects of Ehree importante territorial 
EAGtOrs. 


The authors suggested that another ‘ojgreKelbVonwaliong! 
measure, the Simple Achievement Score (SAS), might be just 
as useful as the BAS. Since "Average Production Per 
Recruiter in Subject's DRC" explained the most variance in 
the regression equation, a score based on the individual's 
performance compared to that average would be easier to 
compute. (SAS correlated highly with BAS (r = .96), so the 
fCwo scores were practically equivalent.) 

The second objective of this study was to develop a 
recruiter selection battery. The battery was developed 
based on the pilot study by Graham et al. (Ref. 8] involving 
interviews with 79 Army recruiters with high, medium, and 
low records of success. Personnel from Army Recruiting 
Headquarters were also consulted about traits necessary for 
recruiter success. 

The selection battery consisted of 12 paper-and- 
pencil inventories and one verbal performance test. Below 
is a list of the measures included in the battery. 

a. Verbal Fluency. Recruiters were asked to make a 
sales pitch to a prospective enlistee about the benefits 
of Army life. Presentations were scored by computing 
the ratio of the number of words spoken in two minutes 
to the number of "ahs" spoken. The authors hypothesized 
that an effective recruiter must be able to talk easily 
in a variety of social situations, and they wanted 


to measure verbal fluency orally, in the most 
realistic situation possible. 
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b- @so0cilabiiliriy “Measurecs Four inventories were used 


to measure a recruiter's sociability and affiliative 

tendency. The authors hypothesized that sociability 
was important since a recruiter must spend so much 
time interacting with people (who often are strangers). 


c. Achievement Motivation. Three inventories were 
used to measure the tendency to work hard to achieve 
self-appointed goals. This was hypothesized to be a 
positive characteristic of a good recruiter. 


ad. Empathy Measures. Four instruments were used to 
measure the ability to understand the point of view 
of others and the drive to win or complete a sale. 
The authors believed empathy alone is not’ enough. 
The successful recruiter goes on to close the sale. 


e. Rejection Tolerance Measure. One inventory was 
used to measure tolerance to rejection, rebuffs, and 


insults. The hypothesis was that the successful 
recruiter has a higher tolerance for rejection than 
does the less successful recruiter. 


f. Responsibility and Maturity Measures. Three 


instruments collected information about a recruiter's 
ability to manage his personal, financial, and official 
duties. Since recruiters spend the bulk of their duty 
time working without supervision, and since they 
represent their branch of service to the general public, 
they are expected to manage their personal, financial, 
and official dwetes@with disecretion- 

When the time came to administer the battery, the 
criterion development project mentioned earlier (BAS and 
SAS) was not yet completed. Instead, the authors created a 
Composite Supervisory Rating procedure to select highly 
successful and very unsuccessful recruiters. Recruiters 
were nominated by supervisors. The best were used in the 
High Criterion Group, and the poorest were used in the Low 
Criterion Group. The battery was administered, and 


information on each recruiter's race, religion, and aptitude 


scores was obtained from Army personnel files. 
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None of the personality measures or aptitude scores 
differentiated significantly between the two groups. The 
verbal performance test and 22 other items differentiated 
ssomiaicantly (Cp s< .10). These items pertained to work 
habits, style of handling finances and debts, educational 
background, and reactions to challenging or stressful 
meu atIons. 

The authors suggested that because recruiters are a 
relatively homogeneous group required to meet several 
minimum qualifications (age, rank, GCT scores), and because 
of their length of time in service (mean was 14 years), the 
recruiters may have had similar attitudes and opinions, 
which would have limited the variance in attitude, personal 
preference, and personality inventory scores. (The few 
items that did discriminate were mostly from the Background 
Information Form and Personnel Questionnaire, instruments 
dealing mainly with matters of fact rather than attitude. ) 

In his review of this study, however, Borman 
Suggested the low relationships between predictors and the 
Sameer ion Could also have been the result of the criterion 
measure used. Had the authors been able to use the Simple 
Achievement Score (SAS) they had suggested, rather than 
Supervisor nominations, higher validities might have 


Peoulted. (Ref. 3:p. 131. 


49 


Although 20 variables were significant (ines 


study, they were not cross-validated. Nonetheless, the 
authors were encouraged about the possible utility of the 


variables in future work. 


C. ASSESSMENT CENDERS 
1. Borman et al. 

In 1982 the assessment center concept was added to 
the Army recruiter training process. Assessment centers are 
believed to be particularly valuable for selection of 
individuals for sales positions, and military recruiterswane 
essentially salespeople. Since assessment centers US Wale 
involve parts of an actual job under observation, they are 
equally adaptable for training for these jobs. [Ref. 20] 

Borman investigated the use of assessment centers to 
select Army recruiters and decided the approach had promise 
(Ref. 21). Under this approach, trained observers rated 
potential recruiters’ performance in several different 
situational exercises that simulated aspects of the 
recruiter job. Assessors were interested in personal 
characteristics such as persuasiveness, sociability 
flexibility, and practical judgment. 

Results showed that this method could successfully 
predict recruiter school performance even with a sample of 


recruiters that had been pre-screened by a selection panel. 
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The assessment center concept is based on the 
assumption that people being rated want the job. Yet, 
requirements for recruiters have grown, forcing the Army to 
assign most of its recruiters involuntarily. This made 
infeasible the use of assessment center ratings to select 
recruiters. The Army's problem had become one of motivation 
and development rather than selection. 50, the purpose of 
Ene assessment center shifted. 

Assessment exercises were cut dramatically. Instead 
of being used for selection, ratings given in a_ revised 
Recruiter Development Center were designed to give recruiter 
trainees a realistic job preview and the positive feedback 
they needed to enhance their motivation. 

2. Weltin et al. 

This study related the ratings of the original 
assessment center and a subsequent development center sample 
to the number of contracts the new recruiter produced in the 
Eerst year on the job. The criterion measure accounted for 
geographic differences in sales potential among recruiting 
battalions. (Ref. 22) Previous work by Brown et al. [Ref. 


5] showed that production per recruiter in the subject's 


battalion (district) accounted for 48 percent of the 
variance in production scores. Some Army recruiting 
battalions have better sales markets than others. aie’ 


control for these geographic differences in sales potential, 


Weltin et al., partialed the number of contracts per 


a 


recruiter achieved in his battalion of assignment from each 


recruiter's performance score. While Borman's work related 
assessment center ratings to training performance, this 
study evaluated the usefulness of the ratings for predicting 
job performance as a field recruiter. 

The assessment center sample included 41 of 57 
soldiers who had taken the original battery of assessment 
center exercises in 1981 and completed the training course. 
Each individual had been rated by trained assessors in 
exercises that included cold calls, interviews, a speech, 
and the in-basket (work prioritization). Other predictors 
included training school grades (written test scores and 
instruccor ratings OE telephone and interviewing 
techniques), and scores on the following: a test battery 
developed to select Navy recruiters, an experimental Army 
test battery, and the Gordon Personal Profile and Inventory. 

The development center sample included 370 
recruiters who were rated in the center, completed training, 
and had at least one contract their first year on the job. 
Assessors were not trained. Essentially the same exercises 
were used as in the assessment center. No personality oor 
interest batteries were used. Written training grades were 
available, but instructor ratingseeon telephone and 
interviewing techniques were not. 

Results indicated that the assessment center ratings 


had low correlations with job performance; however, in the 
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development center sample, the cold call/interview and 
speech exercises were significant. Training grades were not 
Beeaqictive in either sample. The personality and interest 
test scores significantly predicted job performance. Navy 
test scores (human relations, selling, and organizing 
subscales), the ARI test, and two scales of the Gordon 
Personal Profile and Inventory showed moderate relationships 
with job performance. 

Stepwise regression performed on the development 
Senter Sample indicated that productivity of the recruiter's 
matctatlion was the single most important factor in predicting 
job performance. Ratings on the speech exercise and AFQT 
scores predicted approximately two percent additional 
variance. 

The authors suggested that the sizes of individual 
correlations should be interpreted cautiously due to the 
small size of the assessment center sample, differences in 
rater training, and Assessment Center changes. They also 
noted that the assessment center ratings showed some utility 


as predictors of recruiter performance on the job. 


D. BIOGRAPHIC/DEMOGRAPHIC VARIABLES 
1. Bennett and Haber 
In 1973, these authors investigated various factors 
that influence the productivity of Marine Corps recruiters 


weet. 23). They used multiple regression to analyze the 


2) 5) 


relative importance e) ic sixteen variables on gross 


productivity (average number of recruits enlisted per 
month). Variables were divided into three categories. 
Selection variables included General Comprehension Test 
scores, age, race, level of education, number of dependents, 
previous service as a career planner or drill instructor, 
method of assignment to recruiting duty (volunteer or 
assigned), and opinion about whether recruiting duty was a 
financial hardship. Deployment variables included whether 
recruiters were assigned to their home states, distance from 
home state, type of area assigned to (urban, suburban, or 
rural), number of times assigned, hours per week spent on 
recruiting, and percentage of time spent out of the office 
recruLreing. Evaluation variables included number of months 
on current tour of duty and percentile rank in Marine Corps 
Recruiter Class. 

The authors noted that gross’ productivity was 
determined by regional differences as well as differences in 
individual recruiters. To account for regional difttereneece 
they broke their sample of recruiters into two groups, one 
from recruiting stations with high enlistment rates, and the 
other from stations with low rates of enlistment. 

Several variables were statistically significantly 
related’ to productivicy Results from the high enlistment 
area group indicated that urban and suburban recruiters 


enlisted more people per month than rural recruiters, and 
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recruiters in their home state enlisted more people per 
month than those stationed more than 500 miles outside their 
home state. 

In the low enlistment areas, those who felt 
recruiting duty was a financial hardship enlisted more 
people per month than those who did not. Recruiters with 
prior service as career planners were more productive than 
those who had no experience as career planners. The 
regression equations were not cross-validated. 

2. Best and Wylie 

These authors hypothesized that recruiter 
characteristics could be combined to predict recruiter 
performance [Ref. 24]. To test their hypothesis for Navy 
recruiters, they used a command evaluation of each recruiter 
in their sample as their dependent variable. Special 
consideration was given to selecting independent variables 
that could be obtained easily for each prospective recruiter 
prior to a recruiting assignment. 

The authors generated a cross-tabulation of the 
independent variables they had selected initially, and they 
retained for analysis those variables with the strongest 
relationship to the dependent variable. Those variables 
were: the area where the recruiter had spent his youth 
(urban, suburban or rural); age; General Comprehension Test 
(GCT) score (part of the Armed Services Vocational Aptitude 


Battery (ASVAB)); years of active military service; and 


a5 


proximity of childhood home to amajor body Gf wanes 


grouped into three distance categories (less than 20 miles, 
20-200 miles, and more than 200 miles). 

The regression equation accounted for 34 percent of 
the variation in the dependent variable ‘a = .34), and the 


equation was statistically significant (p < .05) for the 


original sample. Although the equation failed on cross- 


Validation, the authors believed research using this 
approach should continue. The only predictor in use by the 
Navy at this time was the 16PF-m. As mentioned earlier, 


this test battery was a poor predictor of recruiter success, 
and the Navy stopped using it for recruiter selection in 
13976. (REE. 1350. 2a 
Jo. ONUpaAGckKk 

This author attempted to develop a profile of a suc- 
cessful recruiter comprised of a combination of objective 
personal characteristics easily obtainable from existing 
personnel records (Ref. 13). She regressed six independent 
variables against a dependent variable designed to identify 
success, mediocrity, and failure in the recruiting 
assignment. The independent variables were paygrade, 
education, years of service, Navy enlisted entrance test 
scores, rate, and scores on the 16PF-m. Her measure of 
effectiveness was defined in terms of Navy Recruiting 
Command's Honor Roll (five enlistments per month). 


Successful performance was defined as completion of the 


ais) 


twenty-month test period and some level of Honor Roll per- 
Eonmance Mediocre performance was defined as remaining in 
the field for the test period, and failure was being 
transferred early. 

Using multiple regression on the whole sample and on 
varlous subgroups, the explanatory factors explained a low 
fourteen and twenty-one percent of the variance in the case 
of successful and unsuccessful recruiters, respectively. A 
better criterion measure of production probably would have 
given Shupack's model more explanatory power. Eaucation, 
paygrade, and entrance test scores explained the most 
variance among successful recruiters. For unsuccessful 
recruiters, the best predictors were rate, years of service, 
and entrance test scores. 

4. Elig et al. 

In a 1983 working paper, these authors described a 
"new approach to recruiter selection research" (Ref. 4). 
They suggested that previous selection approaches (bio- 
graphical information, personality assessment, and interest 


inventories) were vulnerable to compromise and probably 


would Mere be useful when recruiters were selected 
involuntarily. They also commented on the "criterion 
problem," saying that most researchers had not found an 


adequate performance measure. 


aye 


With these criticisms in mind, along with themiec. 


that the All Volunteer Army's recruiters had become a 
largely non-volunteer force, the authors' research sought 
Ewo- things: 


a. Predictors that were readily available, stable, and 
secure measures of recruiter characteristics, and 


b. Criteria that were readily available, objective perform- 
ance measures Which differentiated among recruit 
characteristics, secure and were relatively free from 
"oppor Cun ty solace: 


The authors used the Enlisted Master File (EMF) as 





their data source for recruiter demographic characteristics 
and the Military Enlistment Processing Station Reporting 
System (MRS) to acquire informatlsoen on recrult 
characteristics. Both types of data are maintained 
routinely by the Army. 

The authors hypothesized that the EMF data would 
provide measures of recruiter characteristics that would be 
useful in predicting productivity as measured by recruit 
characteristics taken from the MRS. They related recruiter 
characteristics to recruit characteristics: and theam 
criterion was adjusted for opportunity bias. Brown et al. 
(Ref. =) accounted for 48 percent of an individual 
recruiter's total production  Syoeusinge average total 
production of all recruiters in the individual's Distmien 
Recruiting Command (DRC) as a_ predictor. Elig et alee 
adjusted their criterion by subtracting spre average 
production from the raw contract totals of each recrulcenea 


the DRC. 
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The sample consisted of 552 male and 60 female 
recruiters on pracuc : 1 On aleve bale; By oe Descriptive 
statistics were used to analyze recruiters' characteristics. 
Those characteristics that correlated with COnMEhac t 
production were identified using analysis of covariance 
techniques. 

Results of this study indicated that opportunity 
bias (DRC Average Production) explained 32 percent of the 


variance in productivity, compared to 48 percent found by 


Brown et al. The remaining variance was believed to have 
resulted from unmeasured opportunity bias, individual 
recruiter differences, and measurement error. All effects 


listed below were significant to at least the .01 level. 


a. Recruiter Education. Recruiters with postsecondary 
education recruited better educated, but lower AFOQT, 
male recruits. 


b. AFQT. Recruiter AFQT correlated positively with recruit 
AFQT in its "prime" market, high school diploma graduate 
and senior males (HSDG/SR), and had little impact on 
females or non-high school graduates (NHSG). 


c. Gender. Recruiter gender had no effect on total numbers 
OEsgquallteyeoft recrudats:. 


d. Age. Older recruiters contracted more male and fewer 
female recruits than younger recruiters. They did this 
by underproducing high AFQT and overproducing low AFQT 
recruits in the HSDG/SR market. In total production, 


younger males outproduced older males, while older females 
outproduced younger females. As Figure 2.2 shows younger 


male recruiters outperformed their female counterparts, 
while older females outperformed all others. 


e. Rank. Higher ranking recruiters achieved success in 


the HSDG/SR market by contracting more low AFQT (category 


IV) recruits than lower ranking recruiters. 
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Peeennie Groupe olkeerecruited like. Black recruiters 
enlisted the most Blacks, Hispanic recruiters enlisted 
the most Hispanics, Whites the most Whites, etc. 

The authors were encouraged by the results of their 
research. They believed recruiter demographic 
characteristics can be related to recruit characteristics 
when opportunity bias 1s removed, and that demographic data 
will be useful for selecting recruiters from a non-volunteer 
pool. Several questions remained. For example: 

1. Would these findings be replicated with other samples 
and in other recruiting environments Ce Gia, where 
unemployment is higher)? 

2. Why do tradeoffs exist between AFQT and education? 
Recruiters who penetrated the HSDG/SR market did so at 
the expense of AFQT. 

3. Are these relationships likely to continue? The data in 
this paper were simple correlations and were not tied to 
a well reasoned theory. At the end of their paper, the 
authors mentioned that they would attempt to cross- 
validate this paper's results and develop a theoretical 
rationale for them. 

E. OVERVIEW 

Although the literature review revealed a considerable 
amount of relevant work, many of the findings were 
disappointing. The profile of a "successful recruiter" seems 
to vary from one study to the next. Table 6 summarizes the 


personal characteristics that prior studies have indicated 


are significantly related to being a successful recruiter. 


ou 


TABLE 6 


Characteristics Related to Recruiter Success: 


Summary of Results 


Plans ahead 

Uses systematic approach in prospecting 
Knowledgeable about recruiting 

sales experience 


Age (older if female, younger if male) 
Marital status 

Education 

Paygrade 

Length of service 

AFQT scores 

Racial match 


Verbal fluency 
Persuasiveness 
Communicates effectively 


Self-motivated 
Ambitious 

Desire to excel 
Aggressive 

Dominant 

Confident 
Enthusiastic, positive 
Mature 

Financially stable 
Extroverted 

Enjoys working with others 
Spontaneous 

Influences others 


Well groomed 


ee 


ee 


Most of the past research on recruiter selection 
suffered from one or more of the same serious flaws: poor 
criterion measurement, lack of Knowledge of the recruiter 
job, and failure of results to remain significant upon 
cross-validation. As aresult, findings of many of these 
studies are of questionable value. 


Most recent work has integrated lessons learned from 


earlier studies. Production measures have become more 
sophisticated, attempting to account for the powerful 
influence of VOoppenbunity ebias,"” or the “effects of 


geographic, socioeconomic and organizational variables on 
individual Reecrpulcer productivity. Comprehensive JOD 
analysis has provided a greater understanding of what the 
recruiter's job really is. Astute researchers, recognizing 
that the military services need different types of selection 
devices now that most recruiters are not volunteers, have 
studied the use of passive selection procedures that use 
existing data and are less subject to compromise. Army 
researchers have described the shift in the purpose of the 
assessment Cenrcer from selection to motivation and 
development. Yet, despite the increased sophistication of 
recent work, a reliable profile of the successful recruiter 
is still not generally agreed upon. Statistically 
significant findings are scarce, and very few results remain 


Significant after cross-validation. 
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The Special Assignment Battery developed by NPRDC and 
the assessment center concept used extensively by the 
military services as well as private industry have provided 
perhaps the most encouraging results in recruiter selection 
research. A major drawback of both methods is their cost. 
Given our current relentless budget-cutting environment, 
cost is a Major consideration: 

The Special Assessment Battery was found to be highly 
valid when recently cross-validated on a sample of Marine 
Corps recruiters. Background and personality characteristics 
and interest patterns appear to be associated with military 
recruiter effectiveness. But the battery is lengthy and 
would be costly to administer. If future non-volunteer 
recruiters who took the battery believed their scores would 
result in a recruiting assignment, potential sabotage would 
reduce the tool's usefulness. To minimize the probability 
of faking responses, personnel could complete the battery 
well before a time when they would associate it with 
reecnuseing duty, such as first reenlistment, and all 
personnel could be required to take it. But this would 
require large-scale administration and large related costs. 

The assessment center concept is heavily used and 
relied upon to select salespeople in private industry. The 
military services use assessment centers as part Or 
recruiter training Ee indoctrinate and familiarize 


recruiters on their way to the field, providing them with 
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the basic skills they'll need in thelr jobs. But assessment 


centers can be costly, too. Those who don't complete 
recruiter training are transferred to other jobs. ier 
addition to wasted transfer dollars caused by the 


unnecessary move, this may cause some other types of 
hardship for the member and/or the member's family. The 
assignment BEOcess must identify another person EOr 
recruiting school, while the empty job in the field remains 
unfilled that much longer, all of which costs money. 

Several studies attempted to identify passive recruiter 
selection procedures that would identify people who were 
most likely to become successful recruiters before they were 
assigned to recruiting duty. Although some personal and 
background characteristics were determined te) be 
statistically significant, little if any mention was’ made 
regarding the relative importance of these characteristics 
in recruiter selection. Budget cuts and increasing numbers 
of non-volunteer recruiters underscore the importance of 
passive selection procedures. Signierecant research 
questions remain unanswered. Of the characteristics 
Believed to be related to successful recruiting, what's the 
most important? What's the next most important? 
Researchers who identified the need for passive, readily 
available measures of recruiter characteristics were on the 
eight track. But how many prospective recruiters possess 


all the characteristics believed to be part of the 
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successful recruiter profile? If one person has some of 
these characteristics, and another person has others, how do 
we choose between them? The next chapter describes a 
methodology Lor making decisions about’ the relative 
importance of characteristics determined in past studies to 


be important in the successful recruiter's profile. 
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IIT. METHODOLOGY 


The Goto eis “ENeSIo = = 1s "EO =Tdenlify personal 
characteristics associated with recruiter success. Insights 
from the study should yield management tools that would 
improve the process of selecting Army Reserve recruiters. 
One approach would conduct analysis of data from Army 
recruiters’ personnel records and other data sources such as 
the Enlisted and Officer Master Files maintained by the 
services. Multivariate analysis such as logit or probit 


could be used to identify those individual characteristics 


associated with a successful recruiter. Some measure of the 
criterion, "recruiter success," would also need to _ be 
determined. 

EO several reasons, an alternate approach co 


multivariate analysis of existing data is needed. Army data 
On personal characteristics of recruiters do not exist. 
Other relevant data were not available. The "criterion 
problem," or lack of a measure that could be used to explain 
the variance in recruiter productivity based solely on 
individual recruiter differences, would have made 
traditional analysis difficult. Without data on individual 
recruiters, even the best criterion would not have been 
useful. Perhaps the strongest argument in favor of an 


alternate approach, however, is the failure of many previous 
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studies to identify through tradieronal analysis 


characteristics predictive of recruiter success. 


A. MULTIATTRIBUTE UTILITY THEORY AND EXPERT SS Ysa. 

The Army Recruiting Command uses a group process’ to 
select es AGR recruiters. Group members review 
applications and make decisions based on a set of published 
Criteria. (This process was described more fully in the 
introduction.) Criteria are not ranked or weighted in order 
of importance. Following an interview, each group member 
makes a decision about an applicant independent of other 
group members as to the probability that an applicant would 
be a successful recruiter. The procedure is subjective and 
is based on the experience, knowledge, judgment and 
intuition of the selecting officials. 

some experts in the process of social decision making 
believe that decisions do, and should, depend on subjective 
quantities such as values and probabilities. Disagreements 
over policy decisions generally hinge on disagreements about 
values. Often, although those in conflict may agree about 
the relative dimensions of value, they disagree about the 
relative importance of various goals. Normally, such 
disagreements are fought out in the context of specific 
decisions, over and over again, at enormous social cost each 


time another decision must be made. (Ref. 25:p. 326] 
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Edwards suggested that organizational decisions should 
depend on some kind of social consensus, or aggregation of 
individual views, rather than on any single individual's 
views. Some aspects of value are matters of objective 
information, expertise, or both. [{Ref. 25:p. 326] 

Edwards proposed the use of multiattribute utility 
measurement as a solution to the problems encountered in 
this arena. The method can spell out explicitly the values 
of each group participant, show how and how much they differ 
and, in the process, reduce the extent of such differences. 
Oe 2st Die S27] 


The Army Recruiting Command may be able to improve its 


selection process by applying Edwards' measurement 
technique. Its group process is affected by differing 
values among group members. By taking into account 


objective information regarding recruiter selection as well 
as relevant expertise among group members or other experts, 
the Army Recruiting Command could agree on a set of values 
for recruiter selection. By negotiating about, agreeing on, 
and (possibly) publicizing this set of values, recruiter 


selection could become more effective. 


Edwards' technique is based on extensive use of simple 
rating procedures. Every decision may have value on a 
number Ot different dimensions. The idea behind 


multiattribute utility measurement is to discover those 
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values, one dimension at a time, and aggregate them across 


dimensions using a suitable aggregation rule and weighting 


procedure. Edwards' procedure for obtaining group consensus 
has ten steps. They are listed briefly below: 

1. Identify the person(s) or organization(s) whose utilities 
are to be maximized. 

2. Identify the issue(s) (decisions) to which the utilities 
needed are relevant. 

3. Identify the entities to be evaluated. (For thewanig 
Recruiting Command, these might be recruiter applicants. ) 

4. Identify the relevant dimensions of value for evaluation 
of the entities. (Specify a simple list of goals that 
seem important for the purpose at hand.) 

5. Rank the dimensions in order of importance. (This can 
be done individually or in groups. An advantage of 
the group process is that arguments get on the table 
up front, and participants are more likely to start 
from a common information base. ) 

6. Rate dimensions in importance, preserving ratios. (How 
much more important is one dimension than another?) 

7. Sum the importance weights, and divide each by the sum. 
This computation converts importance weights into numbers 
that, mathematically, are like probabilities. 

8. Measure the location of each entity being evaluated 


on each dimension. 
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9. Calculate utilities for entities. The equation is 
U =-Fwu ,andXw =1. VU 
i re) a i 
is the aggregate utility for the ith entity. w is 
J 
the normalized importance weight of the jth dimension of 
value, and u is the rescaled position of the 
5) 
ith entity on the jth dimension. Thus w is the 
j 


eubput ofastep j/oeandau | is the output of step 8. 
The equation is the oan for a weighted average. 
10. Decide by maximizing U. Ifa subset of i is to 
be chosen, then the a aas FOr which uu is maximum 
POST eee fo DD t2o— 329 | : 

several types of expert systems’ that incorporate 
multiattribute utility theory have been developed over’ the 
past few years to support decision making. The introduction 
of the personal computer and electronic spreadsheet programs 
aeemcirectiy responsible for the rapidly growing popularity 
Saeeecnese Systems. One such system was selected to examine 
recruiter selection in this’ thesis. Before identifying 
Criteria for selecting this system, however, it will be 
helpful to explain what expert systems are, how they are 
structured, and why they are useful. 

In the late 1970s, expert systems were a conceptual 
breakthrough in the field of computer science known as 
Artificial Intelligence (AI). In the sixties, AI scientists 
had attempted to simulate "thinking" by finding general 


methods for solving broad classes of problems. In the 
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seventies the scientists used more specialized progmanes 
concentrating on techniques such as representation (how to 
formulate the problem to make it easy to solve) and search 
(how to control the search for a solution while minimizing 
required time and computer capacity). When the scientists 
realized that "the problem-solving power of a program comes 
from the knowledge it possesses, not just from the 
formalisms and inference schemes it employs," they developed 
special programs that were expert in some narrow area, and 
this new field was born. [(Ref. 26: p. 4] 

Expert systems, also known as knowledge-based systems, 
apply AI reasoning and problem-solving techniques to 


knowledge about a specific problem to simulate the 


application of human expertise [(Ref. 27:p. 16). This 
allows the system to draw conclusions not programmed 
explicitly into the program. While traditional data 


processing techniques require certain input, use well- 
understood algorithms, and produce correct anSwers, expert 
systems use information that is not always consistent or 
complete, apply symbolic reasoning methods without following 
a numeric model, and produce satisfactory answers. OF 
course, the more knowledge the system has about a problem, 
the more effective the system is likely to be. (Ref. Z7eioe 


is) 
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Several players are involved in the process of building 
an expert system, or knowledge engineering, as depicted in 
Brauree3..., ine expere system rs the computer software that 
solves the problem of interest. The domain or area expert 
is a person known for producing good solutions to the 
particular type of problem under” study. The knowledge 
engineer is someone who Knows how to build expert systems. 
The engineer's tasks include interviewing the experts, 
organizing the knowledge, and deciding how to represent it 
in the expert system. The expert-system-building tool is 
the programming language used by the knowledge engineer to 
build the system. The user is anyone who uses the expert 
system once it is developed. (Ref. 26:p. 9] 

The heart of an expert system is its knowledge, or the 
information needed before the computer program can "behave 
intelligently." This Knowledge is organized by facts and 
rules. Many rules in an expert system are called 
MemGistics, or rules of thumb that limit the search for 
solutions. Expert systems use heuristics because the 
problems these systems try to solve are often difficult and 
poorly understood, and resist rigorous mathematical analysis 
eresalgorithmic solutions. (An algorithmic method provides 
the correct or optimal solution, while the heuristic method 
provides an acceptable one.) Heuristic rules make the 
search for solutions easier and more practical. [Ref. 26:p. 
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Figure 3.1. The Players in the Expert System Game. 
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Knowledge representation, or structuring knowledge in a 
program, can be accomplished by using one or more standard 
techniques. Three techniques used most frequently in 
building expert systems are rules, semantic nets, and 
frames. [Re tea 262 p20) The rule-based technique uses 
IF (condition) and THEN (action) statements. Ifa problem 
matches the IF part of a rule, the THEN action is’ taken. 
This technique is the most popular in building expert 
systems. It provides a natural way to describe processes in 
a complex and rapidly changing environment, offers an 
opportunity to look at the problem one step at a time and 
react appropriately, and simplifies the job of explaining 
what the program did or how it reached a particular 
conclusion. (Ref. 26:p. 21) The rule technique is well- 
suited for representing deductive knowledge, such as cause 
and effect problems [Ref. 27:p. 18]. 

Both frame and semantic nets are frame-based 
representation methods. These methods use a network of 
nodes connected by relations and organized into a hierarchy. 
Each node represents a concept that can be described by 
attributes and values associated with the node. Frames are 
well-suited to represent descriptive and relational 
knowledge that clusters or conforms to stereotypes, and 
semantic nets are useful in modeling classifications or 


casual linkages. [Ref. 27:p. 18] 


75 


Expert systems have been used successfully to solve a4 
wide variety of problems, particularly those requiring the 
sort of judgmental decisions people make every day. The 
most well-known expert system may be MYCIN, which can 
recommend treatments for suspected meningitis and other 
bacterial infections of the blood by analyzing a doctor's 
observations of a patient. [(Ref. 27:p. 16] 

An expert system may be a useful approach to a _ problem 
when: 


- A solution has a high payoff: solutions are needed, and 
other methods have not worked 


- The problem can be solved using an expert's knowledge 
rather than a particular algorithm 


- Experts are available who can formalize the knowledge 
needed to solve the problem 


- The problem does not necessarily have a unique answer,and 
- The problem changes. [Ref. 27:p. 20] 

The expert system selected to examine AGR recruiter 
selection is EXPERT87, a special type of expert 
system/decision aid based upon a concept its designer has 
labeled Quasi-Artificial Intelligence (QAI) [(Ref. 28a0 
Before describing EXPERT87 further, though, an explanation 
of QAI and its advantages over traditional AI in the 
development of expert systems will be helpful. 

Hoffman indicates that significant problems exist in 
traditional AI and expert systems that prevent them from 


being as useful as they might be. Some of these problems 


76 


concern the adequacy of the "cognitive engines" of Al 
systems in their ability to simulate correctly human 
reasoning processes. Other problems concern the 
completeness, generalizability, and yoaLiagity of the 
production rules which are developed, as well as certain 
issues in mathematical statistics. Although solutions’ to 
these and other problems are being sought, Hoffman argues 
that needs exist for expert systems now, andthat QAI, a 
less ambitious variant of AI, may be able to meet some of 
those needs. [Ref. 28:p. 3] 

QAI builds upon a well-defined format for the problem 
space. Mathematically, a QAI problem space is hierarchical 
and geometric, as opposed to linguistic or symbolic, as in 
Al. QAI systems present the attributes of decision 
alternatives by means of (1) well-structured profiles of 
hypothetical case data, rather than by descriptive phrases, 
eZ) queries requiring either binary or BEeobablistic 
judgments, or (3) by means of hypotheticals which require 
the expert to invoke plausible propositions and rules. Est 
QAI, experts' inferential processes are expressed as simple 
functional relationships rather than complex Boolian 
expressions that link large, unstructured sets of production 
rules. (Ref. 28:p. 3] 

QAI is not intended for the breadth of problems Al 
systems hope to solve. It is not meant to be a reasoning or 


problem-solving tool in the formal sense and does not 
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attempt to extract higher levels of meaning from rules or 
propositions which are developed. Rather, QAI is intended 
for the large class of moderately difficult and repetitive 
decision problems which so often face managers and decision 
makers. QAI enables coherent and objective decisions to be 
made when no known criterion or dependent variable is 
available for the development of an empirical model. It 
enables efficient interaction of experts with a knowledge 
base, and a presentation of the process (and results) ina 


form which can be understood by the expert and/or by other 





prospective users of the system. [(Ref. 28:p. 5] 

EXPERT87 provides a format for gathering intuitive 
knowledge from experts in minimal time, and in a manner that 
would permit verifiable estimation of the trustworthiness of 
expert systems that emerge. The method is based on 
mathematical theory that allows the computer program _ to 
generate hierarchically ordered profiles of hypothetical 
alternatives. Hierarchical structuring of a “problem's 
concepts avoids cognitive overload of experts, which assures 
a more beneficial utilization of attribute information. 
Attribute values for profiles the program generates are 
chosen to optimize the likelihood that the expert's 
resulting model correctly represents the expert's intuitive 


knowledge. (Ref. 28:p. 4] 
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Several nperore eevoue Dirmine. ples that underly the 


Gevelopment of EXPERTS87 follow [Ref. 29]: 


i 


Intuition is a component of thought processes. One of 
the basic principles of decision making is that people 


have sound, intuitive bases for acting on given 
problems, even though they can seldom express or 
describe their knowledge objectively. The intuitive 
knowledge they possess about a problem is made up of 
their observations about specific elements or 
attributes of a problem, which they seldom explicate 
when they make subjective judgments or 
evaluations. 


Cognitive abilities are limited. In a well-known 
research article of the 1950‘s, “The Magic Number 


Seven ae hUsmeOh Minus MNO spSyeChologist G. A. Miller 
wrote that humans cannot effectively deal with more 
than about seven concepts at one time. Miller 
demonstrated the validity of this principle, to within 
one or two categories, across a wide spectrum of human 
perceptual and cognitive activities. For this reason, 
EXPERT87 (and other similar software) limits problems 
to seven concepts with seven attributes per concept. 


Cognitions are not easily communicated. People 


cannot communicate very clearly about their 
thought processes. They do not know what information 
is routinely ignored or discounted in their thinking. 
Nor do they often know how much importance’ they 
attach to each item of information, concept, or 
criterion when making decisions. When asked to 
assign weights to those factors which influence 
their decisions, they are often hesitant and 
sometimes unable to do so. 


There is a mathematics of intuitive processes. The 


system is designed to overcome the difficulties 
described above and capture experts’ intuitive 
knowledge without forcing them to think like mathema- 
ticians. The interactive process between expert 
and computer generates the functionality between 
attributes of alternatives and the overall merit of 
the alternatives. The mathematically derived 
functionality of the system makes it unique, an 
expert system which is not "rule-based" in the usual 
sense, but is function-based in the sense of being able 
to express in rather simple algebraic form the funda- 
mental nature of the expert's intuitive processes. 
Now the system can respond to each new decision 


a 


problem using a functional model of expert intuition 


which accurately reflects only the consistent and 
reliable components of these intuitions. 


Hierarchies express relations between concepts and 


attributes "Hierarchies are innate to the human way 
of thinking, of breaking reality in clusters and 
subclusters" (Ref. 30:p. 8-4]. According to Liga 
Whyte, "The immense scope of hierarchical classifica- 
tion is clear: It is the most powerful method of 
classification used by the human brain-mind in 
ordering experience, observations, entities and 
information....The use of hierarchical ordering must 

be as old as human thought, conscious and unconscious." 
(Ref. 30:p. 8-4] In EXPERT87, hierarchies are tree 
structures carefully designed to define a problem 
in a comprehensive, meaningful, and well-organized way. 
Solutions are represented as alternatives, and the 
expert's task is to evaluate the alternatives. When 
the program evaluates an alternative, it uses the 
expert's own set of primary defining concepts and 
attributes. 


Hypothetical constructs can be mapped into intervening 
variables. The difference between concepts and 


attributes is an important part of understanding 
EXPERT87. Attributes are specific, and people agree 
on their meaning. Concepts are general, and indi- 
viduals impose their own unique meaning on concepts 
they use. Psychologists use the terms hypothetical 
construct and intervening variable to make clear the 
distinction between unquantified ideas and operation- 
ally defined measures. Figure 3.2 depicts an 
individual's construct (labeled "V") as a somewhat 
vague and incompletely specified set of ideas. The 
figure illustrates the explication of the construct, 
first by defining it in terms of measurable attributes, 
and then in the generation of an expert system, ora 
functional definition of the construct. lie 
contains a process for mapping information from 
measurable attributes into a measure, here labeled 
an intervening variable. The measure, V, is an 
operational definition of the COnstrvucm 

Figure 3.3 illustrates the substitution of hypothetical 
constructs as concepts of a hierarchy. The linkage 
between attributes and constructs is missing, and 
EXPERT87 will construct this linkage after interacting 
with an expert and using its knowledge about the way 
the expert responds’ to problems. 
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7. Effective decision-aids develop understanding and 


confidence. Principles developed by cognitive 
ESoVMenouogistcmave |6dmatoOuthnesability to represent 
decision processes On a microcomputer, to make explicit 
the underlying (largely intuitive) knowledge and 
expertise of decision-makers, and to structure 


decision problems in hierarchical form. This can 
help users define their terms and concepts and clarify 
their thinking. lt) can “also @help them get a 


better understanding of the consistent and reliable 
components of their intuitive reactions to sets of 
information. 

As in all commercially available expert systems 
software, EXPERT87 is proprietary, therefore detailed 
information about its algorithms and operations is limited. 

To summarize, EXPERT87 was selected for this thesis 
because: 

- the software is easy to use 


- expert systems are developed easily and quickly, 
feedback is immediate, and results are easily understood 


- the software can handle a wide variety of decision making 
problems, and 


- the program's cognitive engine is deductive rather 

than inductive, which simulates human thinking and 

reasoning more accurately than expert systems developed 

with traditional AI. 
See ithe MODEL 

Alternative models of the recruiter selection process 
can be constructed. A particular problem can have more than 
ene ‘'correct" model. According to T. L. Saaty., “Individuals 
informed about a particular problem may structure it 


somewhat differently, but if their judgments are similar, 


their overall answers tend to be similar . . the process 
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is robust" [Ref. 30:p. 8-4]. Saaty's work is the basuemrae 
Expert Choice, another decision support software package. 

Figure 3.4 depicts the hierarchy developed to model the 
profile of a successful recruiter. The goal of the model, 
to "Identify Characteristics of the Successful Recruiter," 
is the node at the top of the hierarchy. 

Based on the literature review and other information, 
Characteristics believed to be related to recruiter success 
have been identified (see Table 6 in Chapter ITI). These 
characteristics are related, and can be organized into 
categories. Logical categories are Administrative Skills, 
Communications Ske 1 ls? Background Characteristics, 
Personality Characteristics, and Specific Experience. These 
categories, or dimensions, become the largest branches, or 
nodes, OF the hierarchy. The characteristics, or 
attributes, within each dimension become smaller branches, 
or nodes, of the hierarchy. 

1. Administrative Skills 
- Planning 
-(Ordani Zing 
The Administrative Skills dimension covers aspects of 
the recruiter's job related to planning and organizing. 
Successful recruiters are well organized. They plan 
well, and use and follow their plans. 

2. Communications Skills 
- Speaking Skills 


= [ntoumine 


84 


“Acar IoOey TN gssoolNsS 


Sumosds sqnyg 
OuluOs4, seqynoey 
@2uUeE1sEdxq Bulynssey 
S2use})edxZ selOoS 


eSoONSiadaaxXa 


lols gias 





JOUINH JO B@SUaS 
edUeHISAaY 
Aysboyu| 
Ayiquxay 4 
P2U39A0I{XKY 
JUEWYWWWOD 
UDIPDAINOW 


SOILSIYSLOVYVHOD 
ALIIVNOSY3d 


ay} JO aTtjoad 


wioddns esnods 
JO9I/9}U| 
aposbdé0g/xnu0Yy 
SOA 

AyWOI1uuyy /e90y 
Jsapuay 

eby 


SOILSINSLOVYVHOD 
QNNOYODHOVa 


S/S Ril volo) Shs 
NOS SS 209 /)S 


STOPOW SUL F°E BANHTY 


bulponsse, 

Buys 

e1i"S e6ornBu0y UBjeu0C 4 
aS Gujyueyes] 

14S Suna 

BIS Ouyyosds 


STUAS 


SNOILVOINNNWOD 





eee Oe ele @ oc 





JEPOW SUL 


Burziuobuo 
Buluudld 


STUHS 


AANILVYLSININGDYV 





oi) 


~ Persuading. 
Many communications skills are related to recrutter 
success. The literature suggests that speaking, 
informing, and persuading are important communica- 
tions skills. 


- Foreign Language Skills. 
The ability to speak a foreign language can be an 
important skill, particularly in markets where 
applicants' parents do not speak English. This skill 
can allow a recruiter to build trust with parents who 
often have a great deal of influence over their 
child's enlistment decision. 


—"Listening skit ise 
A former Navy recruiter who tested the model believes 
listening skills are the most important aspect of a 
recruiter's communication. By asking open-ended 
questions and listening carefully to what the 
potential applicant says, the successful recruiter 
can provide information targeted specifically at the 
needs and desires identified by the individual. The 
attribute, listening skills, was added to the Commun- 
ications Skills dimension. 


= Wreiting Skis: 
Because the recruiter's job involves very little 
writing, it is unlikely that strong writing skies 
are an important characteristic of the successful 


recruiter. But since writing is such a large part of 
communicating, writing skills were included in the 
model. 


3. Background Characteristics 
- Age 


~ Gender. 
The literature varies on the subject of which 
background characteristics are related to recruiter 
success. Regarding age and gender, one study found 
that older women and younger men were more successful 
than their counterparts [Ref. 4]. Other studies 
found that gender made no difference. 


- Years of service. 
With respect to age and years of service, a recruiter 
must have experience in the service and/or be old 
enough to have some credibility. At the same time, 
the recruiter shouldn't be so old or senior that a 
tour in recruiting might be the last one before 
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retirement eligibilty. At such a time, many workers 
become less motivated than in the past, acquiring 
what servicemembers call a "Short timer's attitude.” 
In one study, the oldest recruiters were found to be 
among the least successful, and the authors concluded 
that this "twilight tour effect" may have been 
responsible [Ref 13]. 


auace,y Ech le i eve 
One study found that racial match, or being assigned 
to a market where prospects are people most like the 
recruiter, was related to recruiter success [Ref. 4]. 


—eencel lect. 
Most of the literature suggests that intellect is 
directly and positively related to recruiter success 
-- the smarter the recruiter, the better. Education 
and ASVAB scores are often used as readily available 
measures of intellect. 


- Spouse support. 
One aspect of recruiting that affects the probability 
that a recruiter will be successful is the issue of 
family support, particularly support of the spouse. 
Recruiting duty often means living away from the 
military community and services the family depends 
upon. Living away from military exchanges, commi- 
ssaries, and medical facilities can create or 
increase financial hardship and stress for families. 
Recruiting often involves long hours and large 
amounts of time away from home. Most married (and 
formerly married) recruiters believe it takes a 
strong marriage and an especially Supportive spouse 
to deal well with the added stresses brought on by 
recruiting duty. 


Personality Characteristics 

Although these characteristics may be the most 
difficult to measure, both the literature and re- 
cruiters strongly suggest that this is the most 
important dimension. Some types of people will be 
successful recruiters, while others will not, and 
personality is key. The literature suggests that a 
large number of personality characteristics are related 
to recruiter success (see Table 6 in Chapter II). This 
mest oft Characteristics is too long for EtEhis model (the 
software limits a dimension's attributes to seven for 
reasons explained earlier), so similar characteristics 
were combined, and the seven that seemed the most 
important were selected. 
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- Motivation. 
Drive, energy, ambition, desire to excel, and motiva- 
tion were interpreted similarly by those who tested 
the model. Motivation was selected to describe these 
personality characteristics, which many believe is 
related to success in any endeavor, particularly 
FeCrulcing:. 


- Extroverted. 
Someone who is extroverted and sociable, who enjoys 
working and talking with others, is thought more 
likely to succeed in recruiting than someone who is 
Not. 


- Flexibility 


- Resilience. 
These are believed to be important characteristics 
due to the demanding and changeable nature of 
recruiting. How well a recruiter adjusts to changing 
situations, and how well the recruiter bounces back 
after repeatedly being turned down, are thought to be 
good indicators of a recruiter's ability to succeed 
over time. 


- Sense of humor. 
This may help a recruiter enjoy the job, and life in 
general, and may help Keep the recruiter on an even 
keel in a demanding job. 


- Integrity 


—- Commitment. 
Many recruiters (and former recruiters) believe 
integrity and commitment to the organization are 
critical to recruiting success. All other things 
equal, those recruiters who care about finding good 
people/service matches, putting only the best people 
in their service, and doing the job with integrity 
were thought likely to be the most successful in the 
long cun. 


Specific experience 
Various types of experience are thought to be related 
to recruiter success. 


Recruiting experience. 


This type of experience may be the most relevant, par- 
ticularly if the recruiter did well in the past. 
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- Sales experience. 
imecommayesuostleuce fOr recruiting experience, as 
recruiters are often described as salespeople. 

- Recruiter training. 
Many aspects of recruiter training are thought to be 
important to recruiting success, such as effective 
sales techniques, sales philosophy, etc. 


- Public speaking experience may also be related to 
recruiter success. 


For each of the five dimensions described above, 
EXPERT87 will generate a number of hypothetical profiles 
which each expert will evaluate. The software will generate 
a specially constructed set of attribute values for’ the 
attributes which define the dimension. (The program will 
generate a larger number of profiles for dimensions with 
larger numbers of attributes.) Profiles are presented in 


graphic form for the expert to examine, reflect on, and 


assess, as depicted in Figure 3.5. Experts use their own 
experience, knowledge, and intuition to evaluate the 
dimension. 


After the last profile has been evaluated, the software 
completes its mathematical routines and stores’ functional 
relationships between attributes and dimensions. Now that 
the expert system is in place, it can evaluate real 
alternatives based on each expert's own expertise. One more 
profile is displayed evaluated based on the expert system 
just created. After the expert enters his/her assessment, 
the computer displays its findings. With reasonable care, 
the expert's response should be accurate to within five or 


six percent accuracy [Ref 29:p. 51]. 
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SIMUL ATION 





Real-ife 
Alternatives 





Figure 3.5 Hypothetical Profiles Presented in 
Graphic Form. (Ref. 29) 
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EXPERT87 contains a Fidelity Index which indicates how 
successful the program was in developing an expert system 
that correctly models the expert's own intuitions. ie 
Fidelity is less than 70 percent, the expert's evaluations 
were probably inconsistent, which means that the intuitive 
Or cognitive processes underlying the expert's assessments 
were not used ina consistent way (Ref 29:p. 53]. 

Relative weights are also calculated for each expert, 
indicating how important the attributes or dimensions are. 
The software also determines (for each expert) the shape of 
the function of each attribute, whether the relationship is 
positive or negative, monotonic or non-monotonic, convex, 


concave, or linear. 


eee FHE EXPERTS 

Paul Johnson, a scientist who has studied the behavior 
of human experts for many years, describes what is meant by 
the term "expert": 


An expert is a person who, because of training and 
experience, is able to do things the rest of us cannot; 
experts are not only proficient but also smooth and 
efficient in the actions they take. Experts know a great 
many things and have tricks and caveats for applying what 
they know to problems and tasks; they are also good at 
plowing through irrelevant information in order to get 

at basic issues, and they are good at recognizing problems 
they face as instances of types with which they are 
familiar. Underlying the behavior of experts is the body 
of operative knowledge we have termed expertise. It is 
reasonable to suppose, therefore, that experts are the 
ones to ask when we wish to represent the expertise that 
makes their behavior possible. (Ref. 26:p. 5) 
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In the recruiter selection problem, obvious expemee 
would be ‘those who Know best what it takes to succeed in 
recruiting: recruiters who are doing the job. Current 
experienced AGR recruiters were selected as experts to 
evaluate the model described above. 

Others at various levels of the USAREC chain of command 
are also involved in the AGR recruiter selection process and 
could be considered experts. In waddition ge their 
responsibilities to recruit recruiters, endorse applications 
for recruiting positions, and Serve on the boards used to 
Select AGR recruiters, many of these people also have 
recruiting experience. Experts were sought from these 
various levels of the Army Recruiting organization to 
determine how or whether the profile of the successful 
recruiter changes from one person and/or organizational 
level to another. 

For ease of data collection, experts were located within 
the San Francisco Army Recruiting Battalion, and Recruiting 
Stations within that battalion's Gilroy Company. Five 
experts participated in the project. Experts 1 and 2 are 
Gold Badge AGR recruiters (decorated tow recruiting 
success). Expert 3 is a former AGR recruiter currently 
assigned to the San Francisco Recruiting Battalion. Expert 
4 is a Station Manager and Regular Army recruiter. Expert 5 
is a former AGR recruiter currently assigned to USAREC 


Headquarters. 


2 


D. COMPARISON/CONTRAST OF EXPERTS 

The next chapter will analyze the similarities and 
differences of the expert systems created by each o€ the 
five experts. Trends and relative weights among dimensions 
and attributes will be examined to determine whether a 
consistent, clearly identifiable profile of a successful 
recruiter emerges. The five expert systems will also _ be 
examined to determine whether they vary in any systematic 
way across levels of the Army Recruiting organization. 

The analysis will also include an evaluation Or 
hypothetical recruiter applicants. Not only will this 
provide an opportunity to compare five different experts' 
ratings of the same applicants, it will also be possible to 
determine how and why each expert system rated the 


applicants as it did. 
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IV. ANALYSIS AND _RESUETS 


A. THE EXPERTS 

The expert system developed for each of the five 
recruiting experts will be evaluated and compared in terms 
GE three concepts: Fidelity, Standards, and Discr- 
iminability. The indices for each of these concepts, which 
range from 0 to 100, can be used to interpret the worth of 
an expert system. [It is important to distinguish between 
evaluating the worth of an expert system and determining 
whether the individuals generating the expert systems were, 
in fact, "experts." For example, high Fidelity means only 
that the expert was consistent in evaluating alternatives. 
The indices cannot determine the amount of knowledge an 
individual possesses about a particular subject. 

The Fidelity Index measures how well the expert system 
correctly reproduces the intuitive judgments of the expert. 
If the Fidelity Index is 100, the expert system models’ the 
expert's judgments perfectly. A Fidelity Index of less than 
70 indicates that the expert's evaluations were nei 
consistent, and 40 means they were very inconsistent. The 
software calculates Fidelity Indices for all levels of the 


hierarchical model. 
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After an expert enters assessments of the model's 
hypothetical profiles, the software generates an expert 
system. Once created, the program uses the expert system to 
predict assessments for the same profiles the expert 
reviewed. Any difference between an expert's actual 
assessment of a profile and the expert system's predicted 
Ponuewers  Ccalled@error. ihe SOEEWare —Galcuvates Eor each 
expert the Mean Squared Error within each dimension and _ for 
the overall model. If the Fidelity Index is high, errors 
for individual assessments and the overall Mean Squared 
menor should be small. 

The Standards Index measures the extent to which the 
experts maintain high standards on their assessments of 
hypothetical profiles of recruiters as opposed to being 
lenient or generous. For this measure, an Index of 80 
indicates that the expert has high or exacting standards, 
and 20 indicates leniency. 

The Discrimination Index is a measure of the expert's 
ability to make fine distinctions among hypothetical 
profiles of recruiters. An Index of 80 indicates that the 
expert is highly discerning, and 20 indicates inaccuracy or 
inability to distinguish among profiles. As with the 
Fidelity and Standards Indices, the software calculates 
Discrimination Indices for each dimension as well as the 


overall model. 
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Appendix A displays, for each of the five expert 
systems, the Indices mentioned above as well as the Mean 
Squared Error and the explained variance in each dimension 
and the overall model. 

For all five expert systems, the overall model Fidelity 
Index was above 90, and was at least 90 for most of the 
individual dimensions as well. Results for Experts 1 and 4 
include Fidelity Indices in the high 80s on the Background 
Characteristics dimension. Expert 1's results also include 
a Fidelity Index in the high 80s on the Personality 
Characteristics dimension. (Note: These two dimensions 
contain the largest number of attributes the software 
permits, and several experts expressed the difficulty they 
encountered in making assessments. ) 

For the overall model, the experts' Standards Indices 
ranged f£romo25 ‘to 779- The two AGR recruiters were the most 
lenient, and the Recruiting Station Commander had _ the 
highest Standards Index. Although the Standards Indices 
varied across dimensions for all experts, those experts 
whose Standards Indices were low for the overall model 
tended to have lower Indices than the other experts for the 
individual dimensions as well. 

The experts' Discrimination Indices ranged from 62 to 94 
for the overall model. Expert 3, a former AGR- recruiter, 
had the highest Discrimination Index. Expert 2, currently 
an AGR recruiter, had the lowest, which was still above what 


the software documentation calls the "normal range." 
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B. DIMENSIONS 

Table 7 is an aggregation of relative weights assigned 
to the model's five dimensions by each of the five experts. 
The weights for each column will sum to (approximately) one. 
One interpretation of these weights for Expert 1 is that 
Communications Skills dimension, with a relative weight of 
.37, is approximately four times as important as_ the 
Administrative Skills dimension, which has a relative weight 
one «6.093. Specific Experience (.255) is approximately five 
times as important as Background Characteristics (.058) ina 
successful recruiter. (Appendix B contains more detailed 
data displays for each expert.) 

Table 8 lists the five expert systems! most, second 
most, and least important dimensions as well as their 
relative weights. Personality Characteristics, 
Communication Skills, and Specific Experience were judged 
the most important dimensions. Background Characteristics 
were relatively less important for the five experts. 
Administrative Skills were judged least important by three 


of the five experts. 


e ATTRIBUTES 

This section discusses attributes the experts judged 
most important within the dimensions mentioned earlier. 
Again, further explicit detail for all attributes and 


dimensions of the five expert systems is contained in 
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Appendix Be and each expert's relative weights for 
attributes within a dimension will sum to (approximately) 
one. 
1. Personality Characteristics 

Table 9 examines the judgments the experts made 
about the attributes of the Personality Characteristics 
dimension. Three of five experts judged Motivation most 
important, while the other two experts said Integrity was 
the most important personality attribute. In three of five 
cases, Motivation and/or Integrity were judged nearly three 
times as important as the next closest attribute in this 
dimension. Commitment, Flexibility, and Sense of Humor 
received a variety of judgments. Two experts judged 
Resilience as the least important attribute in this 
dimension. 

2. Communications Skills 

As described in Table 10, the experts consistently 
identified Listening and Informing as the most important 
attributes within the Communication Skills dimension. In 
one case (Expert 4), Listening was nearly six times as 
important as Writing, which was judged least important. 
Persuading and Speaking Skills received a variety Of 
ratings, while Writing Skills and Foreign Language Skills 


were judged least important. 
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3. Specific Experience 

Among the attributes within the Specific Experience 
dimension, Recruiting Experience was most important and 
Public Speaking Experience was least important. For those 
experts who believed that sales experience was a substitute 
for recruiting experience (two of three of these experts are 
AGR recruiters), the two attributes were judged very 
important, and the relative weights for these attributes 
were Similar. The two people whose expert systems 
distinguished between sales and recruiting experience judged 
Recruiting Experience and Recruiter Training as the most 
important attributes in this dimension. Table 11 summarizes 
these judgments. 

4. Background Characteristics 

Although the Background Characteristics dimension 
received a variety of ratings across experts and generally 
was rated less important than other dimensions, the relative 
ranking O£ attributes within this dimension showed 
substantial consistency. Four of five experts judged 
Intellect as the single most important attribute in this 
dimension by a noticeable margin. Spouse Support was judged 
very to moderately important. Gender, Age, Years of 
Service, and Rank/Paygrade received a variety of ratings, 
but in most cases, these attributes were significantly less 


important than other attributes. 
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The five experts were asked to interpret the 
Race /Hehniciity attribute asa “racial match" issue. In 
other words, compared to the other attributes in the 
Background Characteristics dimension, experts were asked how 
important it is for a recruiter to be the same race or have 
the same ethnic background as the people in the recruiter's 
market. This attribute had the largest spread of relative 
weights of the seven in this dimension. One expert judged 


Race/Ethnicity to be slightly more important than Intellect 


but less important than Spouse Support. Another expert 
believed Intellect was 40 times more important than 
Race/Ethnicity. Three experts ranked the attribute second, 


one expert placed it in the middle of seven attributes, and 
one person's expert system assigned it a relative weight of 
nearly zero. 
5. Administrative Skills 

Three of five experts believed Administrative Skills 
was the least important dimension in the model. The other 
two experts ranked this fourth of five dimensions, but for 
four of the five experts, large gaps existed between the 


relative weights assigned Administrative Skills and the next 


most important dimension. Within this dimension, experts 
believed both Planning and Organizing are important 
attributes. Although the Administrative Skills dimension 


was less important relative to others in the model, planning 
and organizing abilities were important, and one skill did 


not substitute for the other. 
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D. COMPARING THE EXPERT SYSTEMS 

This phase of the analysis used the five expert systems 
described above to evaluate a set of five hypothetical 
recruiter applicants. Admittedly, ratings on many 
attributes in the model would not be obtainable from 
existing data, nor could they be measured objectively. To 
obtain ratings on some of these attributes, subjective 
assessments would have to be made. For purposes of the 
analysis, however, an assumption was made that ratings on 
all attributes in the model (1) were measurable and (2) were 
agreed upon by the five experts whose systems were used _ to 
evaluate the "applicants." That is, all of the experts 
assessed the same applicant as possessing the same objective 
profile of attributes. The experts differ (1i£ they do) in 
their relative evaluations of the attributes that contribute 
to being a successful recruiter. 

Five hypothetical recruiter applicants were created for 
evaluation. Their profiles are contained in Table 12. By 
design, two applicants lie at opposite ends of the rating 
scale (1-9) on all attributes. The high-ranked applicant 
should end up as every expert's first choice, and the low- 
ranked applicant should be a unanimously poor or 
unacceptable choice for all experts. These extreme cases 
will illustrate how judgments are affected by the Standards 
Index. Experts whose standards are high tend to assign 


lower ratings than more lenient experts. Recall that 
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TABLE 12 


Attribute Ratings of Five Hypothetical Recruiter Applicants 


Attribute/ 
Applicant A € 


Speaking 5 8 5 

= 

Language 3 5 
itormng | #3 fs | 3 
rerouting | > P@ fs | 3 [2 


= ets 
Race/ 

ekineke 1 ty 3 5 5 5 

Years of 

Service 3 5 5 5 

Rank/ 

Paygrade 3B 5) > 5 


spouse 
SUppOreE 5 5 5 5 9 


TAB er ez 


Attribute Ratings of Five Hypothetical Recruiter =~ -cants 
(Continued) 


lAttribute/ 
Applicant 


Motivation 
Commitment 
Extroverted 
Flexibility 
Integrity 


Resilience 


Sense Of 
Humor 





Sales 
Experience 3 > 9 


Recruiting 

Experience 3 5 
Recruiter 

ITraining 3 5 5 


Public Speaking 
Experience 3 5 5 | 8 9 


CO 
\O 


co 
\O 


I 
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Pepcid ee neCONLdile Gdta Gn the Standards, Fidelity, and 
Discrimination Indices for the five expert systems. 

The other three recruiter applicants also have specially 
constructed sets of attributes. All three have arbitrary 
ratings of five (4.5 is the minimally acceptable rating on 
the scale used by the software) on all attributes except 
those within one of the three dimensions identified earlier 
as the most important according to one or more of the _ five 
experts (Personality Characteristics, Communication Skills, 
and Specific Experience). On these attributes, an applicant 
will have ratings of eight. This will provide an 
opportunity to review the judgments each expert system makes 
and analyze the similarities and differences among them. 

As expected, all five expert systems selected Applicant 
E by an overwhelming margin. As shown in Table 13, on a 
scale of 1-100, overall profile scores range from 86.4 to 
99, which places Applicant E in the Superior range of all 
five expert systems. This is no surprise, as this 
applicant's profile was specially designed to result in 
unanimous selection. The results show that the expert 
systems created by those experts with the highest standards, 
Experts 3 and 4, generally rated applicants lower’ than 
experts with more lenient standards. 

As expected, all five expert systems rejected Applicant 
A. However, if 45 had been the cut-off for minimal 


acceptability, as it is in EXPERT87, Expert 1's rating of 42 


as, 


LW AN3\ aed ys: 


Expert Systems Evaluate Hypothetical Applicants 


CHOICE 
EXPERT 

First 
ae 7 

Second 
. 4 Be 9 

Third 
a 3 re 4 ee a 4 ay 7 
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would have come close to the cut-off, even though Applicant 
A was rated Below Standard (ratings of three) on all 
attributes. Another look at the Standards Indices (Appendix 
A) reveals that Expert 1 has the lowest Standards Index (is 
the most lenient) of the five experts on the Overall 
Protile-. Had the ratings been slightly higher (ratings of 
four on all attributes, for example), this expert system 
(and possibly others) may well have found Applicant A 
acceptable, even though all individual attributes would 
still have been below the acceptable cut-ofé€. 

The most interesting results are for Applicants B, C, 
and five expert systems made. (Detailed evaluations are 
contained in Appendix C.) Only two of the five experts 
agreed on the order in which they would select’ these 
"applicants" to be recruiters. 

A closer look at Table 13 and Appendix C provides some 
interesting insight into the selection problem. Based on 
their expert systems, Experts 2, 3, and 4 ranked Applicant D 
second. Expert 2's rating made Applicant D a_e superior 
choice, yet ratings by Experts 3 and 4 were below 60, and 
Expert 5 regarded Applicant D as minimally acceptable. 

Expert 1 ranked Applicant B second with an overall 
evaluation of 91.4--clearly superior. Yet, two other 
experts rated the same applicant below 60, and Expert 3 


found Applicant B nearly minimally acceptable. 
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Although Expert 5 ranked Applicant C second, there was 
nearly a 40-point gap between Applicants E and C. The 
effects of the Standards Index came into play again here. 
Three experts ranked Applicant C third, but the evaluations 
ranged from 56 to 82.3. Expert 1's lenient standards result 
in her fourth place choice being rated above all other 


experts' second place choices. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSIONS 
T. Past Researcen 

The goals of this thesis were to identify attributes 
associated with successful recruiters, develop and analyze a 
model to identify which attributes make the most valuable 
contributions to successful performance as a recruiter, and 
critique the applicability of existing data for this type of 
analysis. 

An extensive literature review identified many 
previous studies that examined the recruiter selection 
problem. Two distinct types of factors have been examined 
for their utility in predicting whether or not an individual 
would be a successful recruiter. One class of factors 
includes those for which information can be found in 
standard military personnel files. Many studies used 
traditional analytical methods such as regression analysis 
to determine whether recruiter productivity could be 
predicted by various combinations of factors. If these 
factors could be identified, they could be used to select 
for recruiting duty those individuals with the highest 
probability of success. The most frequently used personnel 
file type variables were age, gender, rank, education, 


entrance test scores, etc. 
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The other class of factors are given by specific 
tests to measure various personality characteristics. Past 
studies show that many researchers understood, at least 
intuitively, that successful recruiters possess some common 
personality characteristics. A wide variety of tesn 
batteries have been developed and used with varying amounts 
o£ success. 

Using either set of factors, the results were 
generally disappointing. Recruiter characteristics found to 
be significant varied across studies, and no one reliable 
set of predictive characteristics emerged from such data. 
When significant variables were identified, results either 
could not be duplicated upon cross-validation or were not 
cross-validated at all. Personnel data did not seem _ to 
contain information on the appropriate factors. Personality 
test factors often suffered from the presence of the 
criterion problem in the modeling efforts. 

The criterion problem, Or measuring recruiter 
performance in a reliable and valid manner, was probably the 
single most important reason why past research explained 
relatively little variance in recruiter productiv iy 
Researchers used various measures of performance as_ their 
dependent variable, such as supervisory ratings, school 
performance, percent of quota achieved, and total number of 
enlistments, only to find that each measure suffered from 


its own set of weaknesses. For example, although recruiter 
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production figures were easy to obtain and use, the measure 


was Been inatea by market factors not related to individual 
recruiter productivity. Researchers have worked on this 
problem with some success, but more work is needed. 

The vast majority of military recruiters are not 
volunteers. Therefore, some researchers have argued that 
passive devices are needed to select individuals who are 
most likely to become successful recruiters. They advocate 
a shift away from "fakable" devices such as personality 
tests and favor the use of readily available biographical 
and background information. Recent work identified several 
characteristics that were related to recruiter productivity, 
but the results were not cross-validated. 

Relatively recent efforts by Borman and others have 
led to the development of a Special Assignment Battery 
designed especially for recruiter selection. The Battery 
predicted Navy recruiter performance fairly well and 
achieved similar success ina recent revalidation effort 
using Marine Corps recruiters. This approach appears’ to 
have significant promise. Its only apparent drawback are 
the costs its implementation would involve. 

2. Expert Systems 

This thesis applied a "new" methodology to the 
recruiter selection problem. Referred to as Expert Systems, 
a field within the science of Artificial Intelligence (AI), 


this methodology has been used successfully to solve a wide 
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variety of problems, particularly those that require the 
types of judgmental decisions people make every day. Expert 
Systems use one or more experts’ knowledge, judgments, 
experience, and intuition to solve problems. 

Expert System software called EXPERT87 was selected 
for this thesis. The program is based on a concept called 
QuasiArtificial Intelligence (QAI), which successfully 
avoids some of the problems encountered in traditional AI 
applications. QAI is intended for the many types of 


moderately difficult and repetitive decisions managers’ and 


decision makers face. The method enables users to make 
coherent and objective decisions even when no known 
criterion or dependent variable is available for the 


development of an empirical model. 
3. Profile of the Successful Recruiter 
The model developed for this thesis was based on 


those characteristics that previous studies had found to be 


related to recruiter success. These characteristics were 
arranged in a hierarchical structure. Attributes, or 
specific characteristics, were organized into larger 


dimensions, or branches, of the hierarchy. 

Five Army Recruiting experts evaluated the model, 
and EXPERT87 created their expert systems. A surprisingly 
consistent successful recruiter profile emerged. While the 
five expert systems differed in their relative weightings of 


attributes and dimensions, there was general agreement about 
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which characteristics were more important than others. Of 


the model's five dimensions, Personality Characteristics, 


Communications Skills, and Specific Experience were judged ~ 


most important ina successful recruiter. Within those 
dimensions, the most important attributes were Integrity, 
Motivation, Listening, Pireorming, Sales Experience, 


Recruiting Experience, and Recruiter Training. 


B. RECOMMENDATIONS 
1. Measure the Important Attributes 

These results may have important implications for 
future work in recruiter selection. some researchers 
believe that improved formatting of the problem, better 
analytical techniques, and a more reliable dependent 
variable will improve the ability of traditional personnel 
data file variables (e.g., age, gender, rank, education, 
etc.) to predict recruiter performance. Yet, the results of 
this thesis found that’ these traditional variables 
contribute comparatively little to what the experts judged 
important in a successful recruiter. Characteristics that 
are usually not present in personnel data files appear to be 
much more important. Rather than investing much more time 
and effort using personnel file data to predict performance 
Simply because the data exist, it may be more to the point 
to concentrate on finding ways to measure the attributes the 


experts judged to be relatively more important. 


Ws 


Ze USE SExXDer UES Cenc 
Expert Systems can be applied to this problem and 


improve the quality of recruiter selection décisigmee 
Significant numbers of experts exist who know what is 
required to be a successful recruiter. These individuals 
may or may not be consciously aware of the knowledge, 
experience, judgments, and intuition they possess that could 
be directed toward solutions. As is the case for most 
problems in the real world, there is no one right answer. 
The profile of the successful recruiter probably varies in 
many ways. While one set of attributes may be ideal for one 
particular market or environment, the same profile could 
lead to miserable results elsewhere. At the same time, some 
attributes may be universally important. Elicitation 
procedures such as Expert Systems can help recruiting 
managers decide which models fit best where, and why. 
3. Improve the Model 

The model used in this thesis was a first attempt at 
representing knowledge about the recruiter selection problem 
in hierarchical form. The experts who participated in this 
project made many valuable suggestions for improvement. 
Specifically, adding two more dimensions, attributes that 
describe those dimensions, and separating the personality 
dimension may provide a model yielding even better insights 
to the relative importance of attributes for selecting 


successful recruiters. 
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Such a revised model might look something like the 
mNemeolcturea In Pigure’ oe 1: The changes to the model in 


chapter two include: 


- Two new dimensions have been created, Sociological 
Characteristics and Military Background. 


~ Two attributes, Time Management and Attention to Detail, 
have been added to the Administrative Skills dimension. 


~ Attributes that describe behavior (What I do) have been 
separated from those that describe the ego (Who [ am). 
This results in the replacement of the Personality 
Characteristics dimension with two new dimensions called 
Behavior and Ego. New attributes, Self-image and 
Self-starter, have been added. 


~ Attributes within the Background Characteristics dimen- 
sion have been separated. 


Other improvements of the model could also _ be 
investigated. For example, military experience could be 
separated into Years of Active Duty and Years of Reserve 
Duty . One type of prior military experience may be more 
important than another, and it may be important to have 
relative weights for both types of experience. Geographic 
preference and military occupation may also be factors that 
are valuable Nag! identifying potentially successful 
recruiters. 

4. Work Remaining 

Many possible applications exist for this type of 
analysis and methodology. Expert Systems could be compared 
and contrasted across services to determine whether’ there 
are Significant interservice differences in perceptions and 


knowledge of what characteristics are necessary for a 


IES. 


SUCCESS EUL Reecnu een. As mentioned earlier, Expert Systems 
may be needed for different markets OG recru 1 time 
environments within the U. S. Army Reserve. It may also be 


useful to develop Expert Systems for the Regular Army's 
recruiter selection problem. This may be particularly 
useful in light of the fact that such a high percentage of 
Regular Army recruiters (about 80 percent) are nene 


volunteers. 
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